Abstract:The subpopulation shifting challenge, known as some subpopulations of a category that are not seen during training, severely limits the classification performance of the state-of-the-art convolutional neural networks. Thus, to mitigate this practical issue, we explore incremental subpopulation learning (ISL) to adapt the original model via incrementally learning the unseen subpopulations without retaining the seen population data. However, striking a great balance between subpopulation learning and seen population forgetting is the main challenge in ISL but is not well studied by existing approaches. These incremental learners simply use a pre-defined and fixed hyperparameter to balance the learning objective and forgetting regularization, but their learning is usually biased towards either side in the long run. In this paper, we propose a novel two-stage learning scheme to explicitly disentangle the acquisition and forgetting for achieving a better balance between subpopulation learning and seen population forgetting: in the first “gain-acquisition” stage, we progressively learn a new classifier based on the margin-enforce loss, which enforces the hard samples and population to have a larger weight for classifier updating and avoid uniformly updating all the population; in the second “counter-forgetting” stage, we search for the proper combination of the new and old classifiers by optimizing a novel objective based on proxies of forgetting and acquisition. We benchmark the representative and state-of-the-art non-exemplar-based incremental learning methods on a large-scale subpopulation shifting dataset for the first time. Under almost all the challenging ISL protocols, we significantly outperform other methods by a large margin, demonstrating our superiority to alleviate the subpopulation shifting problem (Code is released in https://github.com/wuyujack/ISL).

Isolation and Impartial Aggregation: A Paradigm of Incremental Learning Without Interference

New Insights on Relieving Task-Recency Bias for Online Class Incremental Learning

Balancing Between Forgetting and Acquisition in Incremental Subpopulation Learning.

Learning to aggregate: A parameterized aggregator to debias aggregation for cross-device federated learning

Mitigating Interference in the Knowledge Continuum through Attention-Guided Incremental Learning

General Incremental Learning with Domain-aware Categorical Representations

Knowledge Aggregation Networks for Class Incremental Learning.

An Experimental Survey of Incremental Transfer Learning for Multicenter Collaboration

A Survey of Incremental Transfer Learning: Combining Peer-to-Peer Federated Learning and Domain Incremental Learning for Multicenter Collaboration

A Novel Server-side Aggregation Strategy for Federated Learning in Non-IID Situations

The Expanding Scope of the Stability Gap: Unveiling its Presence in Joint Incremental Learning of Homogeneous Tasks

Enhancing Consistency and Mitigating Bias: A Data Replay Approach for Incremental Learning

An Efficient and Robust Aggregation Algorithm for Learning Federated CNN.

The Solution for the sequential task continual learning track of the 2nd Greater Bay Area International Algorithm Competition

Clustering-based Domain-Incremental Learning

Temporal-Structure-Assisted Gradient Aggregation for Over-the-Air Federated Edge Learning

Ism-Net: Mining Incremental Semantics for Class Incremental Learning

3EF: Class-Incremental Learning via Efficient Energy-Based Expansion and Fusion

Learning Task-Aware Energy Disaggregation: a Federated Approach

Energy-Aware Analog Aggregation for Federated Learning with Redundant Data

Clustering-based incremental learning for imbalanced data classification