Abstract:Long-tailed visual recognition has received increasing attention in recent years. Due to the extremely imbalanced data distribution in long-tailed learning, the learning process shows great uncertainties. For example, the predictions of different experts on the same image vary remarkably despite the same training settings. To alleviate the uncertainty, we propose a Nested Collaborative Learning (NCL++) which tackles the long-tailed learning problem by a collaborative learning. To be specific, the collaborative learning consists of two folds, namely inter-expert collaborative learning (InterCL) and intra-expert collaborative learning (IntraCL). InterCL learns multiple experts collaboratively and concurrently, aiming to transfer the knowledge among different experts. IntraCL is similar to InterCL, but it aims to conduct the collaborative learning on multiple augmented copies of the same image within the single expert. To achieve the collaborative learning in long-tailed learning, the balanced online distillation is proposed to force the consistent predictions among different experts and augmented copies, which reduces the learning uncertainties. Moreover, in order to improve the meticulous distinguishing ability on the confusing categories, we further propose a Hard Category Mining (HCM), which selects the negative categories with high predicted scores as the hard categories. Then, the collaborative learning is formulated in a nested way, in which the learning is conducted on not just all categories from a full perspective but some hard categories from a partial perspective. Extensive experiments manifest the superiority of our method with outperforming the state-of-the-art whether with using a single model or an ensemble. The code will be publicly released.

libcll: an Extendable Python Toolkit for Complementary-Label Learning

Uncertainty-aware Complementary Label Queries for Active Learning

CLImage: Human-Annotated Datasets for Complementary-Label Learning

Enhancing Label Sharing Efficiency in Complementary-Label Learning with Label Augmentation

Complementary Labels Learning with Augmented Classes

Complementary label learning based on knowledge distillation

Class-Imbalanced Complementary-Label Learning via Weighted Loss

Self-adaptive label discovery and multi-view fusion for complementary label learning

ComCo: Complementary supervised contrastive learning for complementary label learning

Discriminative Complementary-Label Learning with Weighted Loss.

Learning from Complementary Labels Via Partial-Output Consistency Regularization.

Complementary to Multiple Labels: A Correlation-Aware Correction Approach

Complementary Classifier Induced Partial Label Learning

GAN-CL: Generative Adversarial Networks for Learning from Complementary Labels

Learning with Multiple Complementary Labels

Biased Complementary-Label Learning Without True Labels

Can Continual Learning Improve Long-Tailed Recognition? Toward a Unified Framework

Embracing Language Inclusivity and Diversity in CLIP through Continual Language Learning

Exploring Continual Learning for Code Generation Models

Continuous Contrastive Learning for Long-Tailed Semi-Supervised Recognition

NCL++: Nested Collaborative Learning for long-tailed visual recognition