Abstract:In multilabel classification, strong label dependence is present for exploiting, particularly for word-to-word dependence defined by semantic labels. In such a situation, we develop a collaborative-learning framework to predict class labels based on label-predictor pairs and label-only data. For example, in image categorization and recognition, language expressions describe the content of an image together with a large number of words and phrases without associated images. This article proposes a new loss quantifying partial correctness for false positive and negative misclassifications due to label similarities. Given this loss, we develop the Bayes rule to capture label dependence by nonlinear classification. On this ground, we introduce a weighted random forest classifier for complete data and a stacking scheme for leveraging additional labels to enhance the performance of supervised learning based on label-predictor pairs. Importantly, we decompose multilabel classification into a sequence of independent learning tasks, based on which the computational complexity of our classifier becomes linear in the size of labels. Compared to existing classifiers without label-only data, the proposed classifier enjoys the computational benefit while enabling the detection of novel labels absent from training by exploring label dependence and leveraging label-only data for higher accuracy. Theoretically, we show that the proposed method reconstructs the Bayes performance consistently, achieving the desired learning accuracy. Numerically, we demonstrate that the proposed method compares favorably in terms of the proposed and Hamming losses against binary relevance and a regularized Ising classifier modeling conditional label dependence. Indeed, leveraging additional labels tends to improve the supervised performance, especially when the training sample is not very large, as in semisupervised learning. Finally, we demonstrate the utility of the proposed approach on the Microsoft COCO object detection challenge, PASCAL visual object classes challenge 2007, and Mediamill benchmark.

Manifold learning and gradient lifting model-based picture multi-label classification method

A Novel Image Classification Method Based on Manifold Learning and Gaussian Mixture Model

Manifold Regularized Multitask Learning for Semi-Supervised Multilabel Image Classification

GA-Based Weighted Ensemble Learning for Multi-Label Aerial Image Classification Using Convolutional Neural Networks and Vision Transformers

Multiview vector-valued manifold regularization for multilabel image classification

Weak multi-label learning with missing labels via instance granular discrimination

Manifold Transfer Learning via Discriminant Regression Analysis

Unsupervised Image Classifier based on Manifold Learning

Multi-Manifold Deep Metric Learning For Image Set Classification

A Multi-Task Gradient Descent Method for Multi-Label Learning

A Label-Specific Attention-Based Network with Regularized Loss for Multi-label Classification

Joint Multilabel Classification with Community-Aware Label Graph Learning

A discriminative multiple-manifold network for image set classification

Learning Graph Convolutional Networks for Multi-Label Recognition and Applications

Discriminative Regression With Latent Label Learning for Image Classification

PointManifold: Using Manifold Learning for Point Cloud Classification

Vector-Valued Multi-View Semi-Supervsed Learning for Multi-Label Image Classification.

Manifold Regularization Classification Model Based On Improved Diffusion Map

Efficient Multi-Label Classification with Hypergraph Regularization

Conditional Graphical Lasso for Multi-label Image Classification.

Collaborative Multilabel Classification