Abstract:Although deep neural networks have been proved effective in many applications, they are data hungry, and training deep models often requires laboriously labeled data. However, when labeled data contain erroneous labels, they often lead to model performance degradation. A common solution is to assign each sample with a dynamic weight during optimization, and the weight is adjusted in accordance with the loss. However, those weights are usually unreliable since they are measured by the losses of corrupted labels. Thus, this scheme might impede the discriminative ability of neural networks trained on noisy data. To address this issue, we propose a novel reweighting method, dubbed self-reweighting from class centroids (SRCC), by assigning sample weights based on the similarities between the samples and our online learned class centroids. Since we exploit statistical class centers in the image feature space to reweight data samples in learning, our method is robust to noise caused by corrupted labels. In addition, even after reweighting the noisy data, the decision boundaries might still suffer distortions. Thus, we leverage mixed inputs that are generated by linearly interpolating two random images and their labels to further regularize the boundaries. We employ the learned class centroids to evaluate the confidence of our generated mixed data via measuring feature similarities. During the network optimization, the class centroids are updated as more discriminative feature representations of original images are learned. In doing so, SRCC will generate more robust weighting coefficients for noisy and mixed data and facilitates our feature representation learning in return. Extensive experiments on both the synthetic and real image recognition tasks demonstrate that our method SRCC outperforms the state of the art on learning with noisy data.

Learning to reweight examples in multi-label classification

Adaptively Weighted Copy-Decoupling Resampling Strategy for Long-Tailed Multi-label Classification

Learning sample representativeness for class-imbalanced multi-label classification

Improving the Accuracy of Learning Example Weights for Imbalance Classification

Rebalancing Multi-Label Class-Incremental Learning

Weak multi-label learning with missing labels via instance granular discrimination

Balancing Methods for Multi-label Text Classification with Long-Tailed Class Distribution

An Effective Approach for Multi-label Classification with Missing Labels

Boosting label weighted extreme learning machine for classifying multi-label imbalanced data

Learning with Noisy Labels Via Self-Reweighting from Class Centroids

Adaptive Weighted Ranking-Oriented Label Distribution Learning

Study on Multi-label Image Classification Based on Sample Distribution Loss

Semi-automatic Labeling with Active Learning for Multi-label Image Classification.

Distribution-Balanced Loss for Multi-label Classification in Long-Tailed Datasets

A Class Incremental Learning Method with Weight Re-Initialization and Multiple Distillation for Image Classification

Online Multi-Label Classification under Noisy and Changing Label Distribution

Towards Label Imbalance in Multi-label Classification with Many Labels

Multi-label Classification: Dealing with Imbalance by Combining Labels

Scalable Label Distribution Learning for Multi-Label Classification

Multi-label feature selection based on stable label relevance and label-specific features

Multi-label classification with weak labels by learning label correlation and label regularization