Abstract:There is growing interest in multilabel image classification due to its critical role in web-based image analytics-based applications, such as large-scale image retrieval and browsing. Matrix completion (MC) has recently been introduced as a method for transductive (semisupervised) multilabel classification, and has several distinct advantages, including robustness to missing data and background noise in both feature and label space. However, it is limited by only considering data represented by a single-view feature, which cannot precisely characterize images containing several semantic concepts. To utilize multiple features taken from different views, we have to concatenate the different features as a long vector. However, this concatenation is prone to over-fitting and often leads to very high time complexity in MC-based image classification. Therefore, we propose to weightedly combine the MC outputs of different views, and present the multiview MC (MVMC) framework for transductive multilabel image classification. To learn the view combination weights effectively, we apply a cross-validation strategy on the labeled set. In particular, MVMC splits the labeled set into two parts, and predicts the labels of one part using the known labels of the other part. The predicted labels are then used to learn the view combination coefficients. In the learning process, we adopt the average precision (AP) loss, which is particular suitable for multilabel image classification, since the ranking-based criteria are critical for evaluating a multilabel classification system. A least squares loss formulation is also presented for the sake of efficiency, and the robustness of the algorithm based on the AP loss compared with the other losses is investigated. Experimental evaluation on two real-world data sets (PASCAL VOC' 07 and MIR Flickr) demonstrate the effectiveness of MVMC for transductive (semisupervised) multilabel image classification, and show that MVMC can exploit complementary properties of different features and output-consistent labels for improved multilabel image classification.

Discriminative Multiview Nonnegative Matrix Factorization for Classification

Discriminative Multiview Nonnegative Matrix Factorization With Large Margin For Image Classification

A Multiview Learning Framework with a Linear Computational Cost

Multi-View Discriminative Learning Via Joint Non-Negative Matrix Factorization

Discriminative subspace matrix factorization for multiview data clustering

Diverse Non-Negative Matrix Factorization for Multiview Data Representation.

Robust discriminative non-negative matrix factorization.

Dual Regularized Multi-View Non-Negative Matrix Factorization for Clustering.

Multi-View Non-Negative Matrix Factorization by Patch Alignment Framework with View Consistency

Adaptive Multi-view Semi-supervised Nonnegative Matrix Factorization.

Nonnegative Discriminant Matrix Factorization

Semi-Supervised Multi-View Multi-Label Classification Based On Nonnegative Matrix Factorization

Nonnegative Matrix Factorization for Multimodality Data from Multi-source Domain

Multi-view Deep Reciprocal Nonnegative Matrix Factorization

Semi-supervised Multi-view Clustering based on Nonnegative Matrix Factorization with Fusion Regularization

Multiview clustering via consistent and specific nonnegative matrix factorization with graph regularization

Non-negative Matrix Factorization Via Discriminative Label Embedding for Pattern Classification.

Multiview Clustering Based on Non-Negative Matrix Factorization and Pairwise Measurements.

A Discriminant Graph Nonnegative Matrix Factorization Approach to Computer Vision

Multiview matrix completion for multilabel image classification.

Multi-View Classification Via Adaptive Discriminant Analysis.