Abstract:Multi-view representation learning aims to integrate multiple data information from different views to improve the task performance. The information contained in multi-view data is usually complex. Not only do different views contain different information, but also different samples of the same view contain different information. In the multi-view representation learning, most existing methods either simply treat each view/sample with equal importance, or set fixed or dynamic weights for different views/samples, which is not accurate enough to capture the information of dimensions of each sample and causes information redundancy, especially for high-dimensional samples. In this paper, we propose a novel unsupervised multi-view representation learning method based on instance-wise feature selection. A main advantage of instance-wise feature selection in this paper is that one can dynamically select dimensions that favor both view-specific representation learning and view-shared representation learning for each sample, thereby improving the performance from the perspective of model input. The proposed method consists of selector network, view-specific network and view-shared network. Specifically, selector network is used to obtain the selection template, which selects different number of dimensions conducive to representation learning from different samples to solve the sample heterogeneity problem; the view-specific network and view-shared network are used to extract the view-specific and view-shared representations, respectively. The selector network, view-shared network, and view-specific network are optimized alternately. Extensive experiments on various multi-view datasets with clustering and multi-label classification tasks demonstrate that the proposed method outperforms the state-of-the-art multi-view learning methods.

An Information Bottleneck Approach for Multi-View Feature Selection

Multi-View Information Bottleneck Without Variational Approximation

Feature Selection with Conditional Mutual Information Considering Feature Interaction

An Information-Theoretic Approach to Universal Feature Selection in High-Dimensional Inference.

Discovering Common Information in Multi-view Data

Input Feature Selection Method Based on Feature Set Equivalence and Mutual Information Gain Maximization

Large-Margin Multi-ViewInformation Bottleneck

Multi-Objective Genetic Algorithm for Multi-View Feature Selection

Feature selection based on multiview entropy measures in multiperspective rough set

Disentangled Variational Information Bottleneck for Multiview Representation Learning

Differentiable Information Bottleneck for Deterministic Multi-view Clustering

Multi-view Semantic Consistency based Information Bottleneck for Clustering

Deep Embedded Complementary and Interactive Information for Multi-View Classification

Towards Consistency and Complementarity: A Multiview Graph Information Bottleneck Approach

Opportunistic Information-Bottleneck for Goal-oriented Feature Extraction and Communication

Multi-View Clustering from the Perspective of Mutual Information

Adaptive unsupervised multi-view feature selection for visual concept recognition

Instance-wise multi-view representation learning

Higher Order Mutual Information Approximation for Feature Selection