Abstract:Modern assessment demands, resulting from educational reform efforts, call for strengthening diagnostic testing capabilities to identify not only the understanding of expected learning goals but also related intermediate understandings that are steppingstones on pathways to learning goals. An accurate and nuanced way of interpreting assessment results will allow subsequent instructional actions to be targeted. An appropriate psychometric model is indispensable in this regard. In this study, we developed a new psychometric model, namely, the diagnostic facet status model (DFSM), which belongs to the general class of cognitive diagnostic models (CDM), but with two notable features: (1) it simultaneously models students' target understanding (i.e., goal facet) and intermediate understanding (i.e., intermediate facet); and (2) it models every response option, rather than merely right or wrong responses, so that each incorrect response uniquely contributes to discovering students' facet status. Given that some combination of goal and intermediate facets may be impossible due to facet hierarchical relationships, a regularized expectation–maximization algorithm (REM) was developed for model estimation. A log-penalty was imposed on the mixing proportions to encourage sparsity. As a result, those impermissible latent classes had estimated mixing proportions equal to 0. A heuristic algorithm was proposed to infer a facet map from the estimated permissible classes. A simulation study was conducted to evaluate the performance of REM to recover facet model parameters and to identify permissible latent classes. A real data analysis was provided to show the feasibility of the model.

A Dual‐Purpose Model for Binary Data: Estimating Ability and Misconceptions

A Diagnostic Facet Status Model (DFSM) for Extracting Instructionally Useful Information from Diagnostic Assessment

Partial-Mastery Cognitive Diagnosis Models

New Paradigm of Identifiable General-response Cognitive Diagnostic Models: Beyond Categorical Data

A Two-Step Q-Matrix Estimation Method

Explanatory Cognitive Diagnostic Models: Incorporating Latent and Observed Predictors

A Mixture Fluency model using responses and response times with cognitive diagnosis model framework

Application of Bi-factor MIRT and Higher-order CDM Models to an In-house EFL Listening Test for Diagnostic Purposes

New development of cognitive diagnosis models

Diagnosis of Multiple Faults: A Sensitivity Analysis

Modeling question difficulty for unbiased cognitive diagnosis: A causal perspective

HeckmanCD: Exploiting Selection Bias in Cognitive Diagnosis

BNMI-DINA: A Bayesian Cognitive Diagnosis Model for Enhanced Personalized Learning

A Two-Stage Approach to Differentiating Normal and Aberrant Behavior in Computer Based Testing

Unified Uncertainty Estimation for Cognitive Diagnosis Models

Exploring Multiple Strategic Problem Solving Behaviors in Educational Psychology Research by Using Mixture Cognitive Diagnosis Model

Diagnosing Diagnostic Models: From Von Neumann’s Elephant to Model Equivalencies and Network Psychometrics

A One‐Parameter Diagnostic Classification Model with Familiar Measurement Properties

A general nonparametric classification method for multiple strategies in cognitive diagnostic assessment

Multimodal Likelihoods in Educational Assessment

Modification Indices for Diagnostic Classification Models