Abstract:Multi-view data can collaborate with each other to provide more comprehensive information than single-view data. Although there exist a few unsupervised multi-view representation learning methods taking both the discrepancies and incorporating complementary information from different views into consideration, they always ignore the use of inner-view discriminant information. It remains challenging to learn a meaningful shared representation of multiple views. To overcome this difficulty, this paper proposes a novel unsupervised multi-view representation learning model, MRL. Unlike most state-of-art multi-view representation learning, which only can be used for clustering or classification task, our method explores the proximity guided representation from inner-view and complete the task of multi-label classification and clustering by the discrimination fusion representation simultaneously. MRL consists of three parts. The first part is a deep representation learning for each view and then aims to represent the latent specific discriminant characteristic of each view, the second part builds a proximity guided dynamic routing to preserve its inner features of direction,location and etc. At last, the third part, GCCA-based fusion, exploits the maximum correlations among multiple views based on Generalized Canonical Correlation Analysis (GCCA). To the best of our knowledge, the proposed MRL could be one of the first unsupervised multi-view representation learning models that work in proximity guided dynamic routing and GCCA modes. The proposed model MRL is tested on five multi-view datasets for two different tasks. In the task of multi-label classification, the results show that our model is superior to the state-of-the-art multi-view learning methods in precision, recall, F1 and accuracy. In clustering task, its performance is better than the latest related popular algorithms. And the performance varies w.r.t. the dimensionality of G is also made to explore the characteristics of MRL.

Progressive Deep Multi-View Comprehensive Representation Learning.

Comprehensive Multi-view Representation Learning

CAMVR: Context-Adaptive Multi-View Representation Learning for Dense Retrieval

Deep Partial Multi-View Learning

Deep Multi-View Concept Learning.

Multiview Concept Learning Via Deep Matrix Factorization

Progressive Neighbor-masked Contrastive Learning for Fusion-style Deep Multi-view Clustering

Semantically consistent multi-view representation learning

Unbalanced Multi-view Deep Learning

Semisupervised Progressive Representation Learning for Deep Multiview Clustering

Multi-View Concept Learning for Data Representation

Unsupervised multi-view representation learning with proximity guided representation and generalized canonical correlation analysis

Deep Embedded Complementary and Interactive Information for Multi-View Classification

Multi-view inter-modality representation with progressive fusion for image-text matching

Decoupled representation for multi-view learning

Information Theory-Guided Heuristic Progressive Multi-View Coding

Partially Shared Latent Factor Learning with Multiview Data

Multi-View Representation Learning Via View-Aware Modulation

Robust Multi-view Common Component Learning.

Multi-View Incremental Learning with Structured Hebbian Plasticity for Enhanced Fusion Efficiency