Abstract:There is growing interest in multilabel image classification due to its critical role in web-based image analytics-based applications, such as large-scale image retrieval and browsing. Matrix completion (MC) has recently been introduced as a method for transductive (semisupervised) multilabel classification, and has several distinct advantages, including robustness to missing data and background noise in both feature and label space. However, it is limited by only considering data represented by a single-view feature, which cannot precisely characterize images containing several semantic concepts. To utilize multiple features taken from different views, we have to concatenate the different features as a long vector. However, this concatenation is prone to over-fitting and often leads to very high time complexity in MC-based image classification. Therefore, we propose to weightedly combine the MC outputs of different views, and present the multiview MC (MVMC) framework for transductive multilabel image classification. To learn the view combination weights effectively, we apply a cross-validation strategy on the labeled set. In particular, MVMC splits the labeled set into two parts, and predicts the labels of one part using the known labels of the other part. The predicted labels are then used to learn the view combination coefficients. In the learning process, we adopt the average precision (AP) loss, which is particular suitable for multilabel image classification, since the ranking-based criteria are critical for evaluating a multilabel classification system. A least squares loss formulation is also presented for the sake of efficiency, and the robustness of the algorithm based on the AP loss compared with the other losses is investigated. Experimental evaluation on two real-world data sets (PASCAL VOC' 07 and MIR Flickr) demonstrate the effectiveness of MVMC for transductive (semisupervised) multilabel image classification, and show that MVMC can exploit complementary properties of different features and output-consistent labels for improved multilabel image classification.

Matrix Completion for Cross-view Pairwise Constraint Propagation

Pairwise Constraint Propagation on Multi-View Data.

MPC: Multi-view Probabilistic Clustering

Learning Visually Aligned Semantic Graph for Cross-Modal Manifold Matching.

Unified Constraint Propagation on Multi-View Data.

Pairwise Constraint Propagation with Dual Adversarial Manifold Regularization

Exhaustive and Efficient Constraint Propagation: A Semi-Supervised Learning Perspective and Its Applications

Exhaustive and Efficient Constraint Propagation: A Graph-Based Learning Approach and Its Applications

Multi-View Matrix Completion for Clustering with Side Information.

Multi-view Common Component Discriminant Analysis for Cross-view Classification

Low-Rank Multi-View Learning in Matrix Completion for Multi-Label Image Classification

Heterogeneous Constraint Propagation with Constrained Sparse Representation

Constrained Tensor Representation Learning for Multi-View Semi-Supervised Subspace Clustering

Symmetric Graph Regularized Constraint Propagation.

Self-Guided Partial Graph Propagation for Incomplete Multiview Clustering

Multi-View Matrix Decomposition: A New Scheme for Exploring Discriminative Information.

Deep Incomplete Multi-view Clustering with Cross-view Partial Sample and Prototype Alignment

Partial multiview clustering with locality graph regularization

Incomplete Multi-View Clustering Via Correntropy and Complement Consensus Learning

Multiview matrix completion for multilabel image classification.

Aligned Matrix Completion: Integrating Consistency and Independency in Multiple Domains