Abstract:Directly learning from examples of random difficulty levels is often challenging for both humans and machine learning models. A more effective strategy involves exposing learners to examples in a progressive order, from easy to difficult. Curriculum Learning (CL) has been proposed to implement this strategy in machine learning model training. However, two key challenges persist in CL framework design: defining the difficulty of training data and determining the appropriate amount of data to input at each training step. This paper presents a Psychology-based Unified Dynamic Framework for Curriculum Learning (PUDF), drawing inspiration from psychometrics. We quantify the difficulty of training data by applying Item Response Theory (IRT) to responses from Artificial Crowds (AC). This theory-driven IRT-AC approach leads to global (i.e., model-independent) and interpretable difficulty values. Leveraging IRT, we propose a Dynamic Data Selection via Model Ability Estimation (DDS-MAE) strategy to schedule the appropriate amount of data during model training. Since our difficulty labeling and model ability estimation are based on a consistent theory, namely IRT, their values are comparable within the same scope, potentially leading to a faster convergence compared to the other CL methods. Experimental results demonstrate that fine-tuning pre-trained language models with PUDF enhances their performance on the GLUE benchmark. Moreover, PUDF surpasses other state-of-the-art (SOTA) CL methods on the GLUE benchmark. We further explore the components of PUDF, namely the difficulty measurer (IRT-AC) and the training scheduler (DDS-MAE) qualitatively and quantitatively. Lastly, we conduct an ablation study to clarify which components of PUDF contribute to faster convergence and higher accuracy.

Dynamic curriculum learning for conversation response selection

Dialogue Response Selection with Hierarchical Curriculum Learning

Dynamic Curriculum Learning with Co-training for Medical Dialogue Generation

A Psychology-based Unified Dynamic Framework for Curriculum Learning

Small Changes Make Big Differences: Improving Multi-turn Response Selection in Dialogue Systems Via Fine-Grained Contrastive Learning

Dynamic Curriculum Learning for Low-Resource Neural Machine Translation

Combining Curriculum Learning and Knowledge Distillation for Dialogue Generation

Dynamic Data Selection for Curriculum Learning via Ability Estimation

User Adaptive Language Learning Chatbots with a Curriculum

Learning Multi-turn Response Selection in Grounded Dialogues with Reinforced Knowledge and Context Distillation

A Survey on Curriculum Learning

A Comprehensive Survey on Curriculum Learning

Exploring Dense Retrieval for Dialogue Response Selection

CDL: Curriculum Dual Learning for Emotion-Controllable Response Generation

Scheduled Curiosity-Deep Dyna-Q: Efficient Exploration for Dialog Policy Learning

Class Lifelong Learning for Intent Detection via Structure Consolidation Networks

Review and Arrange: Curriculum Learning for Natural Language Understanding

Automated Curriculum Learning for Turn-level Spoken Language Understanding with Weak Supervision

Let's Learn Step by Step: Enhancing In-Context Learning Ability with Curriculum Learning

Grounded Curriculum Learning