Abstract:In multilabel classification, strong label dependence is present for exploiting, particularly for word-to-word dependence defined by semantic labels. In such a situation, we develop a collaborative-learning framework to predict class labels based on label-predictor pairs and label-only data. For example, in image categorization and recognition, language expressions describe the content of an image together with a large number of words and phrases without associated images. This article proposes a new loss quantifying partial correctness for false positive and negative misclassifications due to label similarities. Given this loss, we develop the Bayes rule to capture label dependence by nonlinear classification. On this ground, we introduce a weighted random forest classifier for complete data and a stacking scheme for leveraging additional labels to enhance the performance of supervised learning based on label-predictor pairs. Importantly, we decompose multilabel classification into a sequence of independent learning tasks, based on which the computational complexity of our classifier becomes linear in the size of labels. Compared to existing classifiers without label-only data, the proposed classifier enjoys the computational benefit while enabling the detection of novel labels absent from training by exploring label dependence and leveraging label-only data for higher accuracy. Theoretically, we show that the proposed method reconstructs the Bayes performance consistently, achieving the desired learning accuracy. Numerically, we demonstrate that the proposed method compares favorably in terms of the proposed and Hamming losses against binary relevance and a regularized Ising classifier modeling conditional label dependence. Indeed, leveraging additional labels tends to improve the supervised performance, especially when the training sample is not very large, as in semisupervised learning. Finally, we demonstrate the utility of the proposed approach on the Microsoft COCO object detection challenge, PASCAL visual object classes challenge 2007, and Mediamill benchmark.

Scalable Multilabel Prediction via Randomized Methods

Large-scale Collaborative Prediction Using a Nonparametric Random Effects Model.

Multilabel Classification through Random Graph Ensembles

Scalable Randomized Kernel Methods for Multiview Data Integration and Prediction

Large Margin Metric Learning For Multi-Label Prediction

Exploiting random projections and sparsity with random forests and gradient boosting methods -- Application to multi-label and multi-output learning, random forest model compression and leveraging input sparsity

Multilabel Prediction Via Cross-View Search

Collaborative Multilabel Classification

Learn from your neighbor: Learning multi-modal mappings from sparse annotations

Learned Random Label Predictions as a Neural Network Complexity Metric

Scalable Label Distribution Learning for Multi-Label Classification

Multi-label Classification using Labels as Hidden Nodes

Taming the Sigmoid Bottleneck: Provably Argmaxable Sparse Multi-Label Classification

Spatial best linear unbiased prediction: a computational mathematics approach for high dimensional massive datasets

Robust Adaptive Label Propagation By Double Matrix Decomposition

Adapting RNN Sequence Prediction Model to Multi-label Set Prediction

Scalable Multi-Output Label Prediction: From Classifier Chains to Classifier Trellises

Low-rank Multi-Label Learning Based on Nonlinear Mapping

Solving multiclass support vector machines with LaRank

Large-Scale Multi-Label Learning with Incomplete Label Assignments