Abstract:The subpopulation shifting challenge, known as some subpopulations of a category that are not seen during training, severely limits the classification performance of the state-of-the-art convolutional neural networks. Thus, to mitigate this practical issue, we explore incremental subpopulation learning (ISL) to adapt the original model via incrementally learning the unseen subpopulations without retaining the seen population data. However, striking a great balance between subpopulation learning and seen population forgetting is the main challenge in ISL but is not well studied by existing approaches. These incremental learners simply use a pre-defined and fixed hyperparameter to balance the learning objective and forgetting regularization, but their learning is usually biased towards either side in the long run. In this paper, we propose a novel two-stage learning scheme to explicitly disentangle the acquisition and forgetting for achieving a better balance between subpopulation learning and seen population forgetting: in the first “gain-acquisition” stage, we progressively learn a new classifier based on the margin-enforce loss, which enforces the hard samples and population to have a larger weight for classifier updating and avoid uniformly updating all the population; in the second “counter-forgetting” stage, we search for the proper combination of the new and old classifiers by optimizing a novel objective based on proxies of forgetting and acquisition. We benchmark the representative and state-of-the-art non-exemplar-based incremental learning methods on a large-scale subpopulation shifting dataset for the first time. Under almost all the challenging ISL protocols, we significantly outperform other methods by a large margin, demonstrating our superiority to alleviate the subpopulation shifting problem (Code is released in https://github.com/wuyujack/ISL).

Balancing Between Forgetting and Acquisition in Incremental Subpopulation Learning.

Learning with Recoverable Forgetting

Complementary Learning Subnetworks for Parameter-Efficient Class-Incremental Learning

Multi-Granularity Regularized Re-Balancing for Class Incremental Learning

Rethinking Class-Incremental Learning from a Dynamic Imbalanced Learning Perspective

Long-Tail Class Incremental Learning Via Independent Sub-prototype Construction

ILCOC: an Incremental Learning Framework Based on Contrastive One-class Classifiers

Learning a Unified Classifier Incrementally via Rebalancing

More Task-Balanced Class-Incremental Learning

Discrimination Correction and Balance for Class-Incremental Learning

Defying Imbalanced Forgetting in Class Incremental Learning

On the Exploration of Incremental Learning for Fine-grained Image Retrieval

Class Incremental Learning Based on Local Structure Constraints in Feature Space

Inherit With Distillation and Evolve With Contrast: Exploring Class Incremental Semantic Segmentation Without Exemplar Memory

No One Left Behind: Real-World Federated Class-Incremental Learning

Incremental Learning In Online Scenario

Towards Realistic Incremental Scenario in Class Incremental Semantic Segmentation

Model Behavior Preserving for Class-Incremental Learning

Large Scale Incremental Learning

A Strategy for an Uncompromising Incremental Learner

Ism-Net: Mining Incremental Semantics for Class Incremental Learning