Abstract:In a real-world scenario, an object could contain multiple tags instead of a single categorical label. To this end, multi-label learning (MLL) emerged. In MLL, the feature distributions are long-tailed and the complex semantic label relation and the long-tailed training samples are the main challenges. Semi-supervised learning is a potential solution. While, existing methods are mainly designed for single class scenario while ignoring the latent label relations. In addition, they cannot well handle the distribution shift commonly existing across source and target domains. To this end, a Semi-supervised Dual Relation Learning (SDRL) framework for multi-label classification is proposed. SDRL utilizes a few labeled samples as well as large scale unlabeled samples in the training stage. It jointly explores the inter-instance feature-level relation and the intra-instance label-level relation even from the unlabeled samples. In our model, a dual-classifier structure is deployed to obtain domain invariant representations. The prediction results from the classifiers are further compared and the most confident predictions are extracted as pseudo labels. A trainable label relation tensor is designed to explicitly explore the pairwise latent label relations and refine the predicted labels. SDRL is able to effectively and efficiently explore the feature-label relation as well as the label-label relation knowledge without any extra semantic knowledge. We evaluated SDRL in general and zero-shot multi-label classification tasks and we concluded that SDRL is superior to other SOTA baselines. Furthermore, extensive ablation studies have been done which reveal the effectiveness of each component in our framework.

A Dual-Branch Learning Model with Gradient-Balanced Loss for Long-Tailed Multi-Label Text Classification

Label Distribution Learning-Enhanced Dual-KNN for Text Classification

Dual Enhancement for Multi-Label Learning with Missing Labels

Cumulative Dual-Branch Network Framework for Long-Tailed Multi-Class Classification

A dual-branch model with inter- and intra-branch contrastive loss for long-tailed recognition

Long-Tailed Learning as Multi-Objective Optimization

Distribution-Balanced Loss for Multi-label Classification in Long-Tailed Datasets

Residual diverse ensemble for long-tailed multi-label text classification

Balancing Methods for Multi-label Text Classification with Long-Tailed Class Distribution

Improving Tail Label Prediction for Extreme Multi-label Learning

Semi-Supervised Dual Relation Learning for Multi-Label Classification

GREB: Gradient Re-Balanced Loss for Long-Tailed Multi-Lable Classification

On the Value of Head Labels in Multi-Label Text Classification

Label-Specific Feature Augmentation for Long-Tailed Multi-Label Text Classification

Effective Multi-Label Active Learning for Text Classification

Gated Neural Network with Regularized Loss for Multi-label Text Classification.

A Label-Specific Attention-Based Network with Regularized Loss for Multi-label Classification

Multi-label Text Classification Model Based on Multi-level Constraint Augmentation and Label Association Attention

Asynchronous Modeling: A Dual-phase Perspective for Long-Tailed Recognition

Dual-branch Branch Networks Based on Contrastive Learning for Long-Tailed Remote Sensing

Does Tail Label Help for Large-Scale Multi-Label Learning