Skip to main content

Statistical Methods for Validation of Assessment Scale Data in Counseling and Related Fields



Statistical Methods for Validation of Assessment Scale Data in Counseling and Related Fields

Dimiter M. Dimitrov

ISBN: 978-1-119-01928-2 November 2014 259 Pages


“Dr. Dimitrov has constructed a masterpiece—a classic resource that should adorn the shelf of every counseling researcher and graduate student serious about the construction and validation of high quality research instruments.

—Bradley T. Erford, PhD

Loyola University Maryland

Past President, American Counseling Association


“This book offers a comprehensive treatment of the statistical models and methods needed to properly examine the psychometric properties of assessment scale data. It is certain to become a definitive reference for both novice and experienced researchers alike.”

—George A. Marcoulides, PhD

University of California, Riverside


This instructive book presents statistical methods and procedures for the validation of assessment scale data used in counseling, psychology, education, and related fields. In Part I, measurement scales, reliability, and the unified construct-based model of validity are discussed, along with key steps in instrument development. Part II describes factor analyses in construct validation, including exploratory factor analysis, confirmatory factor analysis, and models of multitrait-multimethod data analysis. Traditional and Rasch-based analyses of binary and rating scales are examined in Part III.

Dr. Dimitrov offers students, researchers, and clinicians step-by-step guidance on contemporary methodological principles, statistical methods, and psychometric procedures that are useful in the development or validation of assessment scale data. Numerous examples, tables, and figures provided throughout the text illustrate the underlying principles of measurement in a clear and concise manner for practical application.

*Requests for digital versions from the ACA can be found on 
*To request print copies, please visit the ACA website here.
*Reproduction requests for material from books published by ACA should be directed to


Preface vii

Acknowledgments ix

About the Author xi

PART I Scales, Reliability, and Validity

Chapter 1 Variables and Measurement Scales 3

1.1 Variables in Social and Behavioral Research 3

1.2 What Is Measurement? 4

1.3 Levels of Measurement 5

1.4 Typical Scales for Assessment in Counseling 7

1.5 Scaling 13

Summary 20

Chapter 2 Reliability 23

2.1 What Is Reliability? 23

2.2 Classical Concept of Reliability 24

2.3 Types of Reliability 28

2.4 Stratifi ed Alpha 35

2.5 Maximal Reliability of Congeneric Measures 38

Summary 39

Chapter 3 Validity 41

3.1 What Is Validity? 41

3.2 Unifi ed Construct-Based Model of Validity 42

Summary 50

Chapter 4 Steps in Instrument Development 53

4.1 Definition of Purpose 53

4.2 Instrument Specifi cations 54

4.3 Item Development 59

Summary 64

PART II Factor Analysis in Construct Validation

Chapter 5 Exploratory Factor Analysis 69

5.1 Correlated Variables and Underlying Factors 69

5.2 Basic EFA Models 70

5.3 The Principal Factor Method of Extracting Factors 73

5.4 Rotation of Factors 76

5.5 Some Basic Properties 79

5.6 Determining the Number of Factors 81

5.7 Higher-Order Factors 86

5.8 Sample Size for EFA 87

5.9 Data Adequacy for EFA 87

5.10 EFA With Categorical Data 89

5.11 EFA in Collecting Evidence of Construct Validity 90

Summary 91

Chapter 6 Confirmatory Factor Analysis 95

6.1 Similarities and Differences of EFA and CFA 95

6.2 CFA Model Specifi cation 97

6.3 Dependent and Independent Variables in CFA 98

6.4 CFA Model Parameters 99

6.5 CFA Model Identification 100

6.6 Evaluation of CFA Model Adequacy 102

6.7 Factorial Invariance Across Groups 110

6.8 Testing for Factorial Invariance 112

6.9 Comparing Groups on Constructs 118

6.10 Higher-Order CFA 122

6.11 Points of Caution in Testing for Factorial Invariance 131

6.12 Sample Size for CFA 133

Summary 134

Chapter 7 CFA-Based Models of Multitrait–Multimethod Data 143

7.1 Conventional MTMM Analysis 143

7.2 The Standard CFA Model 145

7.3 The CU Model 147

7.4 The CU–CFA Model 150

7.5 The Correlated Trait–Correlated Method Minus One [CTC(M – 1)] Model 152

7.6 The Random Intercept Factor Model 156

7.7 The Hierarchical CFA (HCFA) Model 159

7.8 The Multilevel CFA (ML-CFA) Method 162

7.9 Conventional MTMM Analysis Using Latent Variable Modeling 165

7.10 Brief Guidelines for Selecting Models of MTMM Data 167

Summary 169

PART III Psychometric Scale Analysis

Chapter 8 Conventional Scale Analysis 175

8.1 Analysis of Binary Scales 175

8.2 Analysis of Rating Scales 181

8.3 Estimation of Reliability for Congeneric Measures 186

Summary 188

Chapter 9 Rasch-Based Scale Analysis 191

9.1 Rasch Model for Binary Data 191

9.2 Rating Scale Model (RSM) 200

Summary 216

References 219

Index 249 See more American Counseling Association titles!