Abstract:The excellent performance of deep neural networks on image classification tasks depends on a large-scale high-quality dataset. However, the datasets collected from the real world are typically biased in their distribution, which will lead to a sharp decline in model performance, mainly because an imbalanced distribution results in the prior shift and covariate shift. Recent studies have typically used a two-stage learning method consisting of two rebalancing strategies to solve these problems, but the combination of partial rebalancing strategies will damage the representational ability of the networks. In addition, the two-stage learning method is of little help in addressing the problem of covariate shift. To solve the above two issues, we first propose a sample logit-aware reweighting method called (SLA), which can not only repair the weights of majority class hard samples and minority class samples but will also integrate with logit adjustment to form a stable two-stage learning strategy. Second, to solve the covariate shift problem, inspired by ensemble learning, we propose a multi-domain expert specialization model, which can achieve a more comprehensive decision by averaging expert classification results from multiple different domains. Finally, we combine SLA and logit adjustment into a two-stage learning method and apply our model to the CIFAR-LT and ImageNet-LT datasets. Compared with the most advanced methods, our experimental results show excellent performance.

Neural Network Ensemble With Evolutionary Algorithm for Highly Imbalanced Classification

Genetic Ensemble of Extreme Learning Machine

A Novel Cost Sensitive Neural Network Ensemble for Multiclass Imbalance Data Learning

Measure Optimized Cost-Sensitive Neural Network Ensemble for Multiclass Imbalance Data Learning

A neural network learning algorithm for highly imbalanced data classification

Evolving Neural Networks with Maximum AUC for Imbalanced Data Classification

Concurrent Optimization of Multiple Base Learners in Neural Network Ensembles: an Adaptive Niching Differential Evolution Approach

Coevolutionary Learning of Neural Network Ensemble for Complex Classification Tasks

Hybrid Ensemble Construction with Selected Neural Networks.

ASE: Anomaly Scoring Based Ensemble Learning for Highly Imbalanced Datasets.

Manifold Cluster-Based Evolutionary Ensemble Imbalance Learning.

Dynamic Neural Network Ensemble Construction For Classification

Improving imbalance classification via ensemble learning based on two-stage learning

Ensemble Approach for Class-imbalanced Classification

Evolving Diverse Ensembles Using Genetic Programming for Classification with Unbalanced Data

Ensemble weighted extreme learning machine for imbalanced data classification based on differential evolution

A Novel Evolutionary Algorithm Ensemble for Global Numerical Optimization.

Towards Designing Neural Network Ensembles by Evolution

A Classification Approach Based on Evolutionary Neural Networks

A Dual Evolutionary Bagging for Class Imbalance Learning

A hybrid ensemble and evolutionary algorithm for imbalanced classification and its application on bioinformatics