Abstract:Few-shot class-incremental learning is crucial for developing scalable and adaptive intelligent systems, as it enables models to acquire new classes with minimal annotated data while safeguarding the previously accumulated knowledge. Nonetheless, existing methods deal with continuous data streams in a centralized manner, limiting their applicability in scenarios that prioritize data privacy and security. To this end, this paper introduces federated few-shot class-incremental learning, a decentralized machine learning paradigm tailored to progressively learn new classes from scarce data distributed across multiple clients. In this learning paradigm, clients locally update their models with new classes while preserving data privacy, and then transmit the model updates to a central server where they are aggregated globally. However, this paradigm faces several issues, such as difficulties in few-shot learning, catastrophic forgetting, and data heterogeneity. To address these challenges, we present a synthetic data-driven framework that leverages replay buffer data to maintain existing knowledge and facilitate the acquisition of new knowledge. Within this framework, a noise-aware generative replay module is developed to fine-tune local models with a balance of new and replay data, while generating synthetic data of new classes to further expand the replay buffer for future tasks. Furthermore, a class-specific weighted aggregation strategy is designed to tackle data heterogeneity by adaptively aggregating class-specific parameters based on local models performance on synthetic data. This enables effective global model optimization without direct access to client data. Comprehensive experiments across three widely-used datasets underscore the effectiveness and preeminence of the introduced framework.

Flexible Few-Shot Class-Incremental Learning with Prototype Container

Self-Promoted Prototype Refinement for Few-Shot Class-Incremental Learning

Few-Shot Incremental Learning for Label-to-Image Translation

Learning Class-level Prototypes for Few-shot Learning

Few-Shot Class-Incremental Learning via Training-Free Prototype Calibration

Rethinking Few-Shot Class-Incremental Learning: A Lazy Learning Baseline

A Cognition-Driven Framework for Few-Shot Class-Incremental Learning

Few-Shot Class-Incremental Learning with Non-IID Decentralized Data

Adaptive Federated Few-Shot Feature Learning with Prototype Rectification

Prototypes Sampling Mechanism for Class Incremental Learning

Few-Shot Class-Incremental Learning Via Feature Space Composition

Few-shot Class Incremental Learning Via Prompt Transfer and Knowledge Distillation

Few Shot Class Incremental Learning via Efficient Prototype Replay and Calibration

Task Consistent Prototype Learning for Incremental Few-shot Semantic Segmentation

Pseudo Initialization Based Few-Shot Class Incremental Learning

A Density-driven Iterative Prototype Optimization for Transductive Few-shot Learning

Distributed Few-Shot Learning with Prototype Distribution Correction

Class-Incremental Few-Shot Object Detection

PrototypeFormer: Learning to Explore Prototype Relationships for Few-shot Image Classification

Towards Generalized and Incremental Few-Shot Object Detection

Mine-Distill-Prototypes for Complete Few-Shot Class-Incremental Learning in Image Classification