Abstract:Many real-world applications involve data from multiple modalities and thus exhibit the viewheterogeneity. For example, user modeling on social media might leverage both the topology of the underlying social network and the content of the users' posts; in the medical domain, multiple views could be X-ray images taken at different poses. To date, various techniques have been proposed to achieve promising results, such as canonical correlation analysis based methods, etc. In the meanwhile, it is critical for decision-makers to be able to understand the prediction results from these methods. For example, given the diagnostic result that a model provided based on the X-ray images of a patient at different poses, the doctor needs to know why the model made such a prediction. However, state-of-the-art techniques usually suffer from the inability to utilize the complementary information of each view and to explain the predictions in an interpretable manner. To address these issues, in this paper, we propose a deep coattention network for multi-view subspace learning, which aims to extract both the common information and the complementary information in an adversarial setting and provide robust interpretations behind the prediction to the end-users via the co-attention mechanism. In particular, it uses a novel cross reconstruction loss and leverages the label information to guide the construction of the latent representation by incorporating the classifier into our model. This improves the quality of latent representation and accelerates the convergence speed. Finally, we develop an efficient iterative algorithm to find the optimal encoders and discriminator, which are evaluated extensively on synthetic and real-world data sets. We also conduct a case study to demonstrate how the proposed method robustly interprets the predictions on an image data set.

Unsupervised multi-view non-negative for law data feature learning with dual graph-regularization in smart Internet of Things

Feature Extraction Via Multi-View Non-Negative Matrix Factorization with Local Graph Regularization.

Dual Graph-Regularized Multi-view Feature Learning

Multi-level regularization-based unsupervised multi-view feature selection with adaptive graph learning

Deep Co-Attention Network for Multi-View Subspace Learning

Multi-view feature selection via Nonnegative Structured Graph Learning

Graph-regularized Multi-View Semantic Subspace Learning

Flexible Multi-View Unsupervised Graph Embedding

Co-Learning Non-Negative Correlated and Uncorrelated Features for Multi-View Data

Multi-View Unsupervised Feature Selection with Adaptive Similarity and View Weight

Dual Space Latent Representation Learning for Image Representation

Multiple Graph Adaptive Regularized Semi-Supervised Nonnegative Matrix Factorization with Sparse Constraint for Data Representation

Unsupervised Subspace Learning with Flexible Neighboring

Feature Selection and Multi-Kernel Learning for Adaptive Graph Regularized Nonnegative Matrix Factorization.

Centric graph regularized log-norm sparse non-negative matrix factorization for multi-view clustering

Semi-supervised multi-view clustering with dual hypergraph regularized partially shared non-negative matrix factorization

Deep Manifold Regularized Semi-Nonnegative Matrix Factorization for Multi-view Clustering

Semi-supervised Multi-view Clustering based on Nonnegative Matrix Factorization with Fusion Regularization

Unsupervised Multi-View Graph Representation Learning with Dual Weight-Net

Dual-graph Regularized Non-Negative Matrix Factorization with Sparse and Orthogonal Constraints

Semi-Supervised Multiview Feature Selection With Adaptive Graph Learning