Abstract:The computerized adaptive form of cognitive diagnostic testing, CD-CAT, has gained increasing attention in the domain of personalized measurements for its ability to categorize individual mastery status of fine-grained attributes more accurately and efficiently through administering items tailored to one's ability progressively. How to select the next item based on previous response(s) is crucial for the success of CD-CAT. Previous item selection strategies for CD-CAT have often followed a greedy or semi-greedy approach, which makes it difficult to strike a balance between diagnostic performance and item bank utilization. To address this issue, this study takes a graph perspective and transforms the item selection problem in CD-CAT into a path-searching problem, in which paths refer to possible test construction and nodes refer to individual items. A heuristic function is defined to predict the prospect of a path, indicating how well the corresponding test can diagnose the current examinee. Two search mechanisms with different biases towards item exposure control are proposed to approximate the optimal path with the best prospect. The first unused item on the resulting path is selected as the next item. The above components compose a novel CD-CAT item selection framework based on heuristic search. Simulation studies are conducted under a variety of conditions regarding bank designs, bank-quality conditions, and testing scenarios. The results are compared with different types of classic item selection strategies in CD-CAT, showing that the proposed framework can enhance bank utilization at a smaller cost of diagnostic performance.

a-Stratified Multistage Computerized Adaptive Testing with b Blocking

A-Stratified Multistage Computerized Adaptive Testing

Dynamic A-Stratified Method for Controlling Item Exposure in Computerized Adaptive Testing

A Robust Computerized Adaptive Testing Approach in Educational Question Retrieval

To Weight or Not to Weight? Balancing Influence of Initial Items in Adaptive Testing

Applying Unidimensional and Multidimensional Item Response Theory Models in Testlet-Based Reading Assessment

Efficiency of computerized adaptive testing with a cognitively designed item bank

Approach to Fitting Testlet for Computerized Adaptive Language Testing

A Two-Stage Approach to Differentiating Normal and Aberrant Behavior in Computer Based Testing

Novel item selection strategies for cognitive diagnostic computerized adaptive testing: A heuristic search framework

A two‐step item bank calibration strategy based on 1‐bit matrix completion for small‐scale computerized adaptive testing

Balancing Test Accuracy and Security in Computerized Adaptive Testing

A Bounded Ability Estimation for Computerized Adaptive Testing

Detecting uniform differential item functioning for continuous response computerized adaptive testing

Nonlinear Sequential Designs for Logistic Item Response Theory Models with Applications to Computerized Adaptive Tests

Ability Assessment Based on CAT in Adaptive Learning System

Addressing Selection Bias in Computerized Adaptive Testing: A User-Wise Aggregate Influence Function Approach

Design and Application of a Response-Driven Adaptive Test System

Test Fairness: Examining Differential Functioning of the Reading Comprehension Section of the GSEEE in China

Multidimensional Computerized Adaptive Testing for Classifying Examinees With Within-Dimensionality

Development and Validation of A Computer Adaptive Efl Test