Abstract:Educational testing intends to measure person's ability, and tests are designed for various objectives. While the ideal pure power tests and pure speed tests do not meet the practical needs in test administration, speeded tests become the primary option. The tradeoff between speed and accuracy is an important issue, especially in speeded tests, and being able to collect and analyze item response time, which is the amount of time an examinee devotes to a particular item until answering it correctly, provides an opportunity to investigate the relationship between response accuracy and response times. A few methods have been proposed to capture such relationship. This dissertation addresses the issue in the context of computer-based testing (CBT), where response times can be automatically recorded. An important component, time limits, in speeded tests is considered. The proposed mixture model incorporates both (potential) response accuracy and response times. In the spirit of speeded tests, it takes into account the possibility that some examinees are not potentially capable of solving a certain item, as in a pure power test, and decomposes response times into finite response times for those who are potentially capable and infinite response times for others. Time limits are represented in terms of censoring: some response times are censored because the problem solving procedures are terminated due to time limits. The proportion of examinees who are potentially capable of solving a particular item is modeled by a regular Item Response Theory (IRT) model. The parameter estimation method is first validated in extensive simulation studies, and the results of real data analysis indicate that the proposed mixture model outperforms the methods in which the impact of time limits is ignored.

Using Response Times and Response Accuracy to Measure Fluency Within Cognitive Diagnosis Models

A Mixture Fluency model using responses and response times with cognitive diagnosis model framework

Cognitive Diagnosis Modeling Incorporating Response Times and Fixation Counts: Providing Comprehensive Feedback and Accurate Diagnosis

Exploring Latent Constructs through Multimodal Data Analysis

Cognitive Diagnosis Modelling Incorporating Response Times and Fixation Counts: Providing A More Comprehensive and Accurate Diagnosis of Problem-Solving

Introducing Response Time into Guessing and Slipping for Cognitive Diagnosis

New Paradigm of Identifiable General-response Cognitive Diagnostic Models: Beyond Categorical Data

New development of cognitive diagnosis models

Application of Bi-factor MIRT and Higher-order CDM Models to an In-house EFL Listening Test for Diagnostic Purposes

Cognitive Diagnosis Focusing on Knowledge Concepts

Diagnosing Writing Ability Using China’s Standards of English Language Ability: Application of Cognitive Diagnosis Models

Partial-Mastery Cognitive Diagnosis Models

A Cognitive Diagnosis Framework Based on Peer Assessment.

A Mixture Response Time Process Model for Aberrant Behaviors and Item Nonresponses

A Diagnostic Facet Status Model (DFSM) for Extracting Instructionally Useful Information from Diagnostic Assessment

Contributions to the statistical analysis of item response time in educational testing

A Mixture Cure-Rate Model for Responses and Response Times in Time-Limit Tests

Multidimensional Latent Cognitive Diagnosis Based on Rough Concept Analysis and Item Response Theory

Fuzzy Cognitive Diagnosis for Modelling Examinee Performance

A Comparative Study of Item Response Theory Models for Mixed Discrete-Continuous Responses

Joint Testlet Cognitive Diagnosis Modeling for Paired Local Item Dependence in Response Times and Response Accuracy