Abstract:Deep learning models suffer from catastrophic forgetting when learning new tasks incrementally. Incremental learning has been proposed to retain the knowledge of old classes while learning to identify new classes. A typical approach is to use a few exemplars to avoid forgetting old knowledge. In such a scenario, data imbalance between old and new classes is a key issue that leads to performance degradation of the model. Several strategies have been designed to rectify the bias towards the new classes due to data imbalance. However, they heavily rely on the assumptions of the bias relation between old and new classes. Therefore, they are not suitable for complex real-world applications. In this study, we propose an assumption-agnostic method, Multi-Granularity Regularized re-Balancing (MGRB), to address this problem. Re-balancing methods are used to alleviate the influence of data imbalance; however, we empirically discover that they would under-fit new classes. To this end, we further design a novel multi-granularity regularization term that enables the model to consider the correlations of classes in addition to re-balancing the data. A class hierarchy is first constructed by ontology or grouping semantically or visually similar classes. The multi-granularity regularization then transforms the one-hot label vector into a continuous label distribution, which reflects the relations between the target class and other classes based on the constructed class hierarchy. Thus, the model can learn the inter-class relational information, which helps enhance the learning of both old and new classes. Experimental results on both public datasets and a real-world fault diagnosis dataset verify the effectiveness of the proposed method. Code is available at https://github.com/lilyht/CIL-MGRB.

Graph-Based Class-Imbalance Learning With Label Enhancement

Class-Imbalanced Graph Learning without Class Rebalancing

Handling Inter-class and Intra-class Imbalance in Class-imbalanced Learning

Rethinking the Value of Labels for Improving Class-Imbalanced Learning

Rebalancing Multi-Label Class-Incremental Learning

Towards Deeper Insights into Deep Learning from Imbalanced Data.

Self-paced Ensemble for Highly Imbalanced Massive Data Classification

Imbalanced graph learning via mixed entropy minimization

Semi-Supervised Graph Imbalanced Regression

Multi-label Classification: Dealing with Imbalance by Combining Labels

Meta-Hybrid: Integrate Meta-Learning to Enhance Class Imbalance Graph Learning

Learning Balanced Bayesian Classifiers from Labeled and Unlabeled Data

Rethinking Class Imbalance in Machine Learning

BIM: Improving Graph Neural Networks with Balanced Influence Maximization

Class-Imbalanced Deep Learning via a Class-Balanced Ensemble

Improving imbalance classification via ensemble learning based on two-stage learning

Multi-Granularity Regularized Re-Balancing for Class Incremental Learning

A Novel Ensemble Method for Classifying Imbalanced Data

A Theoretical Analysis of the Learning Dynamics under Class Imbalance

Boosting label weighted extreme learning machine for classifying multi-label imbalanced data

Balanced Masking Strategy for Multi-Label Image Classification.