Stable and Diverse: A Unified Approach for Computerized Adaptive Testing
Yuting Ning,Ye Liu,Zhenya Huang,Haoyang Bi,Qi Liu,Enhong Chen,Dan Zhang
DOI: https://doi.org/10.1109/ccis53392.2021.9754532
2021-01-01
Abstract:Computerized Adaptive Testing (CAT), aiming to provide personalized tests for each examinee, is an emerging task in the intelligent education field. A CAT system selects questions step by step according to the knowledge states of each examinee, which are estimated by Cognitive Diagnosis Models (CDM). Most existing methods depend on the performance of a single CDM, which is often unstable. Besides, they may select similar questions to generate a test, which to some extent ignores the diversity of selected questions. To this end, in this paper, we propose a novel framework, namely Ensembled Computerized Adaptive Testing (EnCAT). Specifically, EnCAT comprises two components, ensemble part and explore part. In the ensemble part, we ensemble multiple CDMs to determine whether a question is informative, which ensures the stability of CAT process. Then, in the explore part, we learn the question representation from the question content and design a mechanism to quantify the similarity of different questions, which avoids the selection of similar questions and is free of expensive human labeling. Finally, extensive experiments are conducted on a real-world dataset, where the experimental results demonstrate the effectiveness of our proposed EnCAT framework with good performance.