Abstract:Large deep learning models are impressive, but they struggle when real-time data is not available. Few-shot class-incremental learning (FSCIL) poses a significant challenge for deep neural networks to learn new tasks from just a few labeled samples without forgetting the previously learned ones. This setup can easily leads to catastrophic forgetting and overfitting problems, severely affecting model performance. Studying FSCIL helps overcome deep learning model limitations on data volume and acquisition time, while improving practicality and adaptability of machine learning models. This paper provides a comprehensive survey on FSCIL. Unlike previous surveys, we aim to synthesize few-shot learning and incremental learning, focusing on introducing FSCIL from two perspectives, while reviewing over 30 theoretical research studies and more than 20 applied research studies. From the theoretical perspective, we provide a novel categorization approach that divides the field into five subcategories, including traditional machine learning methods, meta learning-based methods, feature and feature space-based methods, replay-based methods, and dynamic network structure-based methods. We also evaluate the performance of recent theoretical research on benchmark datasets of FSCIL. From the application perspective, FSCIL has achieved impressive achievements in various fields of computer vision such as image classification, object detection, and image segmentation, as well as in natural language processing and graph. We summarize the important applications. Finally, we point out potential future research directions, including applications, problem setups, and theory development. Overall, this paper offers a comprehensive analysis of the latest advances in FSCIL from a methodological, performance, and application perspective.

Sharpness-aware gradient guidance for few-shot class-incremental learning

Few-Shot Incremental Learning with Continually Evolved Classifiers

A Cognition-Driven Framework for Few-Shot Class-Incremental Learning

Self-supervised Contrastive Feature Refinement for Few-Shot Class-Incremental Learning.

Model Attention Expansion for Few-Shot Class-Incremental Learning

Improved Continually Evolved Classifiers for Few-Shot Class-Incremental Learning

Bias Mitigating Few-Shot Class-Incremental Learning

MetaFSCIL: A Meta-Learning Approach for Few-Shot Class Incremental Learning

Rethinking Few-shot Class-incremental Learning: Learning from Yourself

Enhanced Few-Shot Class-Incremental Learning via Ensemble Models

Few Shot Class Incremental Learning via Efficient Prototype Replay and Calibration

Covariance-based Space Regularization for Few-shot Class Incremental Learning

A survey on few-shot class-incremental learning

Learning with Fantasy: Semantic-Aware Virtual Contrastive Constraint for Few-Shot Class-Incremental Learning

Mamba-FSCIL: Dynamic Adaptation with Selective State Space Model for Few-Shot Class-Incremental Learning

A Bag of Tricks for Few-Shot Class-Incremental Learning

S3C: Self-Supervised Stochastic Classifiers for Few-Shot Class-Incremental Learning

Knowledge Adaptation Network for Few-Shot Class-Incremental Learning

FSCIL-EACA: Few-Shot Class-Incremental Learning Network Based on Embedding Augmentation and Classifier Adaptation for Image Classification

Few-Shot Class-Incremental Learning Via Class-Aware Bilateral Distillation

Uncertainty-Guided Semi-Supervised Few-Shot Class-Incremental Learning With Knowledge Distillation