Abstract:Few-shot class-incremental learning (FSCIL) aims to continually learn new classes using a few samples while not forgetting the old classes. The key of this task is effective knowledge transfer from the base session to the incremental sessions. Despite the advance of existing FSCIL methods, the proposed knowledge transfer learning schemes are sub-optimal due to the insufficient optimization for the model's plasticity. To address this issue, we propose a Random Episode Sampling and Augmentation (RESA) strategy that relies on diverse pseudo incremental tasks as agents to achieve the knowledge transfer. Concretely, RESA mimics the real incremental setting and constructs pseudo incremental tasks globally and locally, where the global pseudo incremental tasks are designed to coincide with the learning objective of FSCIL and the local pseudo incremental tasks are designed to improve the model's plasticity, respectively. Furthermore, to make convincing incremental predictions, we introduce a complementary model with a squared Euclidean-distance classifier as the auxiliary module, which couples with the widely used cosine classifier to form our whole architecture. By such a way, equipped with model decoupling strategy, we can maintain the model's stability while enhancing the model's plasticity. Extensive quantitative and qualitative experiments on three popular FSCIL benchmark datasets demonstrate that our proposed method, named Knowledge Transfer-driven Relation Complementation Network (KT-RCNet), outperforms almost all prior methods. More precisely, the average accuracy of our proposed KT-RCNet outperforms the second-best method by a margin of 5.26%, 3.49%, and 2.25% on miniImageNet, CIFAR100, and CUB200, respectively. Our code is available at <a class="link-external link-https" href="https://github.com/YeZiLaiXi/KT-RCNet.git" rel="external noopener nofollow">this https URL</a>.

RRA-FFSCIL: Inter-intra classes representation and relationship augmentation federated few-shot incremental learning

SR-FDIL: Synergistic Replay for Federated Domain-Incremental Learning

Federated Learning with Unsourced Random Access.

FedFRR: Federated Forgetting-Resistant Representation Learning

Joint Local Relational Augmentation and Global Nash Equilibrium for Federated Learning with Non-IID Data

Privacy-Preserving Federated Class-Incremental Learning

Towards Efficient Replay in Federated Incremental Learning

Addressing Catastrophic Forgetting in Federated Learning on Resource-Constrained Devices: A Feature Replay Approach

Adaptive Federated Learning on Non-IID Data with Resource Constraint

FedSKF: Selective Knowledge Fusion via Optimal Transport in Federated Class Incremental Learning

SRFL: A Secure & Robust Federated Learning Framework for IoT with Trusted Execution Environments

A Fair Federated Learning Framework with Reinforcement Learning.

Lightweight Industrial Image Classifier Based on Federated Few-Shot Learning.

Data-Free Federated Class Incremental Learning with Diffusion-Based Generative Memory

Federated Class-Incremental Learning with Dynamic Feature Extractor Fusion

FL-Clip: Bridging Plasticity and Stability in Pre-Trained Federated Class-Incremental Learning Models

No One Left Behind: Real-World Federated Class-Incremental Learning

FRAug: Tackling Federated Learning with Non-IID Features via Representation Augmentation

Knowledge Transfer-Driven Few-Shot Class-Incremental Learning

RAFLS: RDP-Based Adaptive Federated Learning with Shuffle Model

FLea: Addressing Data Scarcity and Label Skew in Federated Learning via Privacy-preserving Feature Augmentation