Abstract:Multi-view representation learning aims to integrate multiple data information from different views to improve the task performance. The information contained in multi-view data is usually complex. Not only do different views contain different information, but also different samples of the same view contain different information. In the multi-view representation learning, most existing methods either simply treat each view/sample with equal importance, or set fixed or dynamic weights for different views/samples, which is not accurate enough to capture the information of dimensions of each sample and causes information redundancy, especially for high-dimensional samples. In this paper, we propose a novel unsupervised multi-view representation learning method based on instance-wise feature selection. A main advantage of instance-wise feature selection in this paper is that one can dynamically select dimensions that favor both view-specific representation learning and view-shared representation learning for each sample, thereby improving the performance from the perspective of model input. The proposed method consists of selector network, view-specific network and view-shared network. Specifically, selector network is used to obtain the selection template, which selects different number of dimensions conducive to representation learning from different samples to solve the sample heterogeneity problem; the view-specific network and view-shared network are used to extract the view-specific and view-shared representations, respectively. The selector network, view-shared network, and view-specific network are optimized alternately. Extensive experiments on various multi-view datasets with clustering and multi-label classification tasks demonstrate that the proposed method outperforms the state-of-the-art multi-view learning methods.

Editorial Paper for Pattern Recognition Letters VSI on Multi-View Representation Learning and Multi-Modal Information Representation

Multi-View Clustering Via Simultaneously Learning Shared Subspace And Affinity Matrix

Salient and consensus representation learning based incomplete multiview clustering

Joint Learning of Latent Similarity and Local Embedding for Multi-View Clustering.

One-Step Multi-View Clustering With Diverse Representation

Does incorporation of cowpea-maize residue mixes influence nitrous oxide emission and mineral nitrogen release in a tropical luvisol?

Instance-wise multi-view representation learning

Learning Disentangled Representation for Multi-View 3D Object Recognition.

Exsavi: Excavating both sample-wise and view-wise relationships to boost multi-view subspace clustering

Multi-view co-clustering with multi-similarity

Multi-level regularization-based unsupervised multi-view feature selection with adaptive graph learning

A Survey on Multi-view Learning

Incomplete multi-view clustering by simultaneously learning robust representations and optimal graph structures

Multi-view Latent Space Learning Based on Local Discriminant Embedding

Uniform Projection for Multi-View Learning.

Multi-view clustering based on pairwise co-regularization and robust dual graph non-negative matrix factorization

Intrinsic Weight Learning Approach for Multi-view Clustering

Learning the Global Descriptor for 3-D Object Recognition Based on Multiple Views Decomposition

Learning Common Semantics via Optimal Transport for Contrastive Multi-View Clustering

Complete multi-view subspace clustering via auto-weighted combination of visible and latent views

Multi-View Clustering and Semi-Supervised Classification with Adaptive Neighbours