Abstract:Multi-view data can collaborate with each other to provide more comprehensive information than single-view data. Although there exist a few unsupervised multi-view representation learning methods taking both the discrepancies and incorporating complementary information from different views into consideration, they always ignore the use of inner-view discriminant information. It remains challenging to learn a meaningful shared representation of multiple views. To overcome this difficulty, this paper proposes a novel unsupervised multi-view representation learning model, MRL. Unlike most state-of-art multi-view representation learning, which only can be used for clustering or classification task, our method explores the proximity guided representation from inner-view and complete the task of multi-label classification and clustering by the discrimination fusion representation simultaneously. MRL consists of three parts. The first part is a deep representation learning for each view and then aims to represent the latent specific discriminant characteristic of each view, the second part builds a proximity guided dynamic routing to preserve its inner features of direction,location and etc. At last, the third part, GCCA-based fusion, exploits the maximum correlations among multiple views based on Generalized Canonical Correlation Analysis (GCCA). To the best of our knowledge, the proposed MRL could be one of the first unsupervised multi-view representation learning models that work in proximity guided dynamic routing and GCCA modes. The proposed model MRL is tested on five multi-view datasets for two different tasks. In the task of multi-label classification, the results show that our model is superior to the state-of-the-art multi-view learning methods in precision, recall, F1 and accuracy. In clustering task, its performance is better than the latest related popular algorithms. And the performance varies w.r.t. the dimensionality of G is also made to explore the characteristics of MRL.

Microvideo Multilabel Learning Model Based on Multiview Low-Rank Representation

A Multiview Learning Framework with a Linear Computational Cost

Common-Individual Semantic Fusion for Multi-View Multi-Label Learning

Multimodal Attentive Representation Learning for Micro-video Multi-label Classification

Embedding Regularizer Learning for Multi-View Semi-Supervised Classification.

Individuality- and Commonality-Based Multiview Multilabel Learning

Reliable Representations Learning for Incomplete Multi-View Partial Multi-Label Classification

Large-Margin Predictive Latent Subspace Learning for Multiview Data Analysis.

Unsupervised multi-view representation learning with proximity guided representation and generalized canonical correlation analysis

Multi-view Low-rank Preserving Embedding: A novel method for multi-view representation

Label-Specific Alignment with Adversarial Multi-View Representation

Low-Rank Multi-View Learning in Matrix Completion for Multi-Label Image Classification

Views Meet Labels: Personalized Relation Refinement Network for Multiview Multilabel Learning

Dual-domain Aligned Deep Hierarchical Matrix Factorization Method for Micro-video Multi-label Classification

Neural Multimodal Cooperative Learning Toward Micro-Video Understanding

Multiview Concept Learning Via Deep Matrix Factorization

Relation-Aware Alignment Attention Network for Multi-view Multi-label Learning.

Partially Shared Latent Factor Learning with Multiview Data

Learning Low-Rank Label Correlations for Multi-label Classification with Missing Labels

LCBM: A Multi-View Probabilistic Model for Multi-Label Classification

Masked Two-channel Decoupling Framework for Incomplete Multi-view Weak Multi-label Learning