An Intelligent Testing Strategy For Vocabulary Assessment Of Chinese Second Language Learners

Wei Zhou,Renfen Hu,Feipeng Sun,Ronghuai Huang
DOI: https://doi.org/10.18653/v1/w19-4403
2019-01-01
Abstract:Testing is an important tool to monitor learning effects. However, it usually costs a large amount of time and human labor to build an item bank and to test large number of students. In this paper, we propose a novel testing strategy by combining automatic item generation (AIG) and computerized adaptive testing (CAT) in vocabulary assessment for Chinese L2 learners. Firstly, we generate three types of vocabulary questions by modeling both the vocabulary knowledge and learners' writing error data. After evaluation and calibration, we construct a balanced item pool with automatically generated items, and implement a three-parameter computerized adaptive test. We conduct manual item evaluation and online student tests in the experiments. The results show that the combination of AIG and CAT can construct test items efficiently and reduce test cost significantly. Also, the test result of CAT can provide valuable feedback to AIG algorithms.
What problem does this paper attempt to address?