Abstract:Cognitive diagnosis is widely applicable in the scenarios where users’ cognitive states need to be assessed, such as games and clinical measurement. Especially in intelligent education, which has become increasingly popular recent decades, cognitive diagnosis serves as a fundamental module for discovering the proficiency level of students on specific knowledge concepts. Existing approaches usually mine linear interactions of student exercising process by manually designed function (e.g., logistic function). However, the cognitive interactions between students and exercises is a complex process, and excessive simplifications would lead to under fitting and thus get inaccurate diagnostic results. Besides, the manually designed interaction functions are relatively inflexible and limits their extensibility. This consequently causes lack of consideration about useful non-numerical information in the cognitive process besides response logs. In this article, we propose a general Neural Cognitive Diagnosis (NeuralCD) framework as well as several implemented models (a basic implementation NeuralCDM and three extensions), where we project students and exercises to factor vectors and incorporates neural networks to learn the complex exercising interactions. To ensure the interpretability of diagnostic results, which is essential for cognitive diagnosis, we apply an monotonicity assumption to our NeuralCD framework. Moreover, NeuralCD is a general framework and has good extensibility. We show the generality of NeuralCD through proving how it can cover some traditional models. Then, we demonstrate the extensibility of NeuralCD, which benefits future developments. On one hand, we demonstrate content-based extensions where we provide examples of exploring the rich contents of exercise texts (CNCD-Q and CNCD-F). On the other hand, we demonstrate a knowledge-association based extension to show that NeuralCD is flexible for structural adjustments so as to solve specific problems. For instance, we improve the diagnostic results on uncovered knowledge concepts of a student by extending NeuralCD with the knowledge associations consideration (KaNCD). Extensive experimental results on real-world datasets show the effectiveness of NeuralCD framework with both accuracy and interpretability.

Neisseria sicca Endocarditis Presenting as Multiple Embolic Brain Infarcts

Validating a Reading Assessment Within the Cognitive Diagnostic Assessment Framework: Q-Matrix Construction and Model Comparisons for Different Primary Grades

Diagnosing listening and reading skills in the Chinese EFL context: Performance stability and variability across modalities and performance levels

Application of Bi-factor MIRT and Higher-order CDM Models to an In-house EFL Listening Test for Diagnostic Purposes

A Cognitive Diagnostic Assessment Study of the Listening Test of the Singapore–Cambridge General Certificate of Education O-Level: Application of DINA, DINO, G-DINA, HO-DINA, and RRUM

An Optimal Choice of Cognitive Diagnostic Model for Second Language Listening Comprehension Test

Diagnosing Writing Ability Using China’s Standards of English Language Ability: Application of Cognitive Diagnosis Models

Application of a Cognitive Diagnostic Model to a High-Stakes Reading Comprehension Test

Coh-Metrix Model-Based Automatic Assessment of Interpreting Quality

Using country-specific Q-matrices for cognitive diagnostic assessments with international large-scale data

The selection of cognitive diagnostic models for a reading comprehension test

New development of cognitive diagnosis models

Cognitive Diagnosis with Explicit Student Vector Estimation and Unsupervised Question Matrix Learning

Cognitive Diagnostic Assessment of IELTS Listening: Providing Feedback from its Internal Structure

Cognitive model construction and assessment of data analysis ability based on CDA

Developing individualized feedback for listening assessment: Combining standard setting and cognitive diagnostic assessment approaches

In Search of Optimal Cognitive Diagnostic Model(s) for ESL Grammar Test Data

BNMI-DINA: A Bayesian Cognitive Diagnosis Model for Enhanced Personalized Learning

Towards a New Generation of Cognitive Diagnosis

Interpretable Cognitive Diagnosis with Neural Network

NeuralCD: A General Framework for Cognitive Diagnosis