Abstract:Few-shot class-incremental learning (FSCIL) aims to continually learn new classes using a few samples while not forgetting the old classes. The key of this task is effective knowledge transfer from the base session to the incremental sessions. Despite the advance of existing FSCIL methods, the proposed knowledge transfer learning schemes are sub-optimal due to the insufficient optimization for the model's plasticity. To address this issue, we propose a Random Episode Sampling and Augmentation (RESA) strategy that relies on diverse pseudo incremental tasks as agents to achieve the knowledge transfer. Concretely, RESA mimics the real incremental setting and constructs pseudo incremental tasks globally and locally, where the global pseudo incremental tasks are designed to coincide with the learning objective of FSCIL and the local pseudo incremental tasks are designed to improve the model's plasticity, respectively. Furthermore, to make convincing incremental predictions, we introduce a complementary model with a squared Euclidean-distance classifier as the auxiliary module, which couples with the widely used cosine classifier to form our whole architecture. By such a way, equipped with model decoupling strategy, we can maintain the model's stability while enhancing the model's plasticity. Extensive quantitative and qualitative experiments on three popular FSCIL benchmark datasets demonstrate that our proposed method, named Knowledge Transfer-driven Relation Complementation Network (KT-RCNet), outperforms almost all prior methods. More precisely, the average accuracy of our proposed KT-RCNet outperforms the second-best method by a margin of 5.26%, 3.49%, and 2.25% on miniImageNet, CIFAR100, and CUB200, respectively. Our code is available at <a class="link-external link-https" href="https://github.com/YeZiLaiXi/KT-RCNet.git" rel="external noopener nofollow">this https URL</a>.

Knowledge Transfer-Driven Few-Shot Class-Incremental Learning

A Cognition-Driven Framework for Few-Shot Class-Incremental Learning

Knowledge Adaptation Network for Few-Shot Class-Incremental Learning

Few-Shot Class-Incremental Learning Via Relation Knowledge Distillation

Learning to Complement: Relation Complementation Network for Few-Shot Class-Incremental Learning.

Few Shot Class Incremental Learning via Efficient Prototype Replay and Calibration

Few-Shot Incremental Learning with Continually Evolved Classifiers

On Distilling the Displacement Knowledge for Few-Shot Class-Incremental Learning

Knowledge Representation by Generic Models for Few-Shot Class-Incremental Learning

Improved Continually Evolved Classifiers for Few-Shot Class-Incremental Learning

Few-shot class-incremental learning based on representation enhancement

MetaFSCIL: A Meta-Learning Approach for Few-Shot Class Incremental Learning

Pseudo Initialization Based Few-Shot Class Incremental Learning

Rethinking Few-shot Class-incremental Learning: Learning from Yourself

FSCIL-EACA: Few-Shot Class-Incremental Learning Network Based on Embedding Augmentation and Classifier Adaptation for Image Classification

Few-Shot Class-Incremental Learning Via Class-Aware Bilateral Distillation

Model Attention Expansion for Few-Shot Class-Incremental Learning

Analogical Learning-Based Few-Shot Class-Incremental Learning

Language-Inspired Relation Transfer for Few-Shot Class-Incremental Learning

Few-Shot Class-Incremental Learning via Training-Free Prototype Calibration

A survey on few-shot class-incremental learning