Abstract:Computerized Adaptive Testing (CAT) is a promising testing mode in personalized online education (e.g., GRE), which aims at measuring student's proficiency accurately and reducing test length. The "adaptive" is reflected in its selection algorithm that can retrieve best-suited questions for student based on his/her estimated proficiency at each test step. Although there are many sophisticated selection algorithms for improving CAT's effectiveness, they are restricted and perturbed by the accuracy of current proficiency estimate, thus lacking robustness. To this end, we investigate a general method to enhance the robustness of existing algorithms by leveraging student's "multi-facet" nature during tests. Specifically, we present a generic optimization criterion Robust Adaptive Testing (RAT) for proficiency estimation via fusing multiple estimates at each step, which maintains a multi-facet description of student's potential proficiency. We further provide theoretical analyses of such estimator's desirable statistical properties: asymptotic unbiasedness, efficiency, and consistency. Extensive experiments on perturbed synthetic data and three real-world datasets show that selection algorithms in our RAT framework are robust and yield substantial improvements.

Computerized adaptive testing: A new trend in language testing

Development and Validation of A Computer Adaptive Efl Test

Validation of Computer-based Language Testing

Approach to Fitting Testlet for Computerized Adaptive Language Testing

Development of the English Test for Chinese Young Learners as a Base for Implementing Online Computerized Adaptive Testing

Design and Application of a Response-Driven Adaptive Test System

Research on Item Response Theory Based System of Computerized Adaptive Testing

A Robust Computerized Adaptive Testing Approach in Educational Question Retrieval

An Intelligent Testing Strategy For Vocabulary Assessment Of Chinese Second Language Learners

Ability Assessment Based on CAT in Adaptive Learning System

The Development of Computerized Adaptive Testing with Cognitive Diagnosis for an English Achievement Test in China

Evaluation of a New Method for Providing Full Review Opportunities in Computerized Adaptive Testing—Computerized Adaptive Testing with Salt

TESTING THE TEST: ASPECTS OF CET 4 REVISITED

The Computerized Adaptive Testing System Based on Item Response Theory

Theory Analysis on Computerized Adaptive Test

The Development of Adaptive Tests

A Preliminary Study of the Validity of the Internet-Based CET-4——Factors Affecting Test-takers' Perception of and Performance on the Test

Survey of Computerized Adaptive Testing: A Machine Learning Perspective

Computer Literacy and the Construct Validity of a High-Stakes Computer-Based Writing Assessment

Self-adaptive Computer Test System with Item Response Theory

Assessing Language Testing: A Corpus-Based Approach