Abstract:Many real-world applications involve data from multiple modalities and thus exhibit the viewheterogeneity. For example, user modeling on social media might leverage both the topology of the underlying social network and the content of the users' posts; in the medical domain, multiple views could be X-ray images taken at different poses. To date, various techniques have been proposed to achieve promising results, such as canonical correlation analysis based methods, etc. In the meanwhile, it is critical for decision-makers to be able to understand the prediction results from these methods. For example, given the diagnostic result that a model provided based on the X-ray images of a patient at different poses, the doctor needs to know why the model made such a prediction. However, state-of-the-art techniques usually suffer from the inability to utilize the complementary information of each view and to explain the predictions in an interpretable manner. To address these issues, in this paper, we propose a deep coattention network for multi-view subspace learning, which aims to extract both the common information and the complementary information in an adversarial setting and provide robust interpretations behind the prediction to the end-users via the co-attention mechanism. In particular, it uses a novel cross reconstruction loss and leverages the label information to guide the construction of the latent representation by incorporating the classifier into our model. This improves the quality of latent representation and accelerates the convergence speed. Finally, we develop an efficient iterative algorithm to find the optimal encoders and discriminator, which are evaluated extensively on synthetic and real-world data sets. We also conduct a case study to demonstrate how the proposed method robustly interprets the predictions on an image data set.

Rank Consistency based Multi-View Learning: A Privacy-Preserving Approach

Multi-View Clustering Via Simultaneously Learning Shared Subspace And Affinity Matrix

View Consistency based Co-training style MultiView Learning : A Privacy-Preserving Approach

Rank-consistency-based Multi-View Learning with Universum

Deep Co-Attention Network for Multi-View Subspace Learning

Rank Consistency Induced Multiview Subspace Clustering Via Low-Rank Matrix Factorization

Multi-View Learning Via Low-Rank Tensor Optimization.

Consensus Low-Rank Multi-View Subspace Clustering with Cross-View Diversity Preserving

Multi-view Low-rank Preserving Embedding: A novel method for multi-view representation

Weighted hybrid fusion with rank consistency

Multi-View Matrix Decomposition: A New Scheme for Exploring Discriminative Information.

Robust Multi-view Subspace Learning Through Structured Low-Rank Matrix Recovery

The similarity-consensus regularized multi-view learning for dimension reduction

Multi-view low-rank matrix factorization using multiple manifold regularization.

Robust Multi-View Clustering Via Inter-and-intra-view Low Rank Fusion

Learning Interpretable Shared Space Via Rank Constraint for Multi-View Clustering.

Cross-View Feature Learning via Structures Unlocking Based on Robust Low-Rank Constraint

Retargeted Multi-View Feature Learning with Separate and Shared Subspace Uncovering

Learning Consensus Representations in Multi-Latent Spaces for Multi-View Clustering

Consistency and Diversity Neural Network Multi-View Multi-Label Learning

Discriminative Multi-View Fusion Via Adaptive Regression