Abstract:In multilabel classification, strong label dependence is present for exploiting, particularly for word-to-word dependence defined by semantic labels. In such a situation, we develop a collaborative-learning framework to predict class labels based on label-predictor pairs and label-only data. For example, in image categorization and recognition, language expressions describe the content of an image together with a large number of words and phrases without associated images. This article proposes a new loss quantifying partial correctness for false positive and negative misclassifications due to label similarities. Given this loss, we develop the Bayes rule to capture label dependence by nonlinear classification. On this ground, we introduce a weighted random forest classifier for complete data and a stacking scheme for leveraging additional labels to enhance the performance of supervised learning based on label-predictor pairs. Importantly, we decompose multilabel classification into a sequence of independent learning tasks, based on which the computational complexity of our classifier becomes linear in the size of labels. Compared to existing classifiers without label-only data, the proposed classifier enjoys the computational benefit while enabling the detection of novel labels absent from training by exploring label dependence and leveraging label-only data for higher accuracy. Theoretically, we show that the proposed method reconstructs the Bayes performance consistently, achieving the desired learning accuracy. Numerically, we demonstrate that the proposed method compares favorably in terms of the proposed and Hamming losses against binary relevance and a regularized Ising classifier modeling conditional label dependence. Indeed, leveraging additional labels tends to improve the supervised performance, especially when the training sample is not very large, as in semisupervised learning. Finally, we demonstrate the utility of the proposed approach on the Microsoft COCO object detection challenge, PASCAL visual object classes challenge 2007, and Mediamill benchmark.

LAMB: A Novel Algorithm of Label Collaboration Based Multi-Label Learning

Dual Enhancement for Multi-Label Learning with Missing Labels

Multi-Label Learning by Exploiting Label Correlations with LDA

Partial Multi-label Learning with Label and Feature Collaboration

Enhancing Label Correlation Feedback in Multi-Label Text Classification via Multi-Task Learning

Learning Label Correlations for Multi-Label Online Passive Aggressive Classification Algorithm

Active Learning with Label Correlation Exploration for Multi-Label Image Classification

Joint Learning of Multi-Label Classification and Label Correlations

Rethinking Modal-oriented Label Correlations for Multi-modal Multi-label Learning

Multi-label text classification via joint learning from label embedding and label correlation

Collaborative Multilabel Classification

Multi-Label Learning by Exploiting Label Correlations Locally

Label Distribution Learning by Exploiting Label Correlations.

Multi-label classification by exploiting local positive and negative pairwise label correlation

Label Distribution Learning: A Local Collaborative Mechanism

Learning Low-Rank Label Correlations for Multi-label Classification with Missing Labels

Collaboration based multi-modal multi-label learning

Exploiting Multi-Label Correlation in Label Distribution Learning

Federated Multi-Label Learning (FMLL): Innovative Method for Classification Tasks in Animal Science

Joint Label-Specific Features and Correlation Information for Multi-Label Learning.

Research of multi-label text classification based on label attention and correlation networks