Abstract:Many real-world applications involve data from multiple modalities and thus exhibit the viewheterogeneity. For example, user modeling on social media might leverage both the topology of the underlying social network and the content of the users' posts; in the medical domain, multiple views could be X-ray images taken at different poses. To date, various techniques have been proposed to achieve promising results, such as canonical correlation analysis based methods, etc. In the meanwhile, it is critical for decision-makers to be able to understand the prediction results from these methods. For example, given the diagnostic result that a model provided based on the X-ray images of a patient at different poses, the doctor needs to know why the model made such a prediction. However, state-of-the-art techniques usually suffer from the inability to utilize the complementary information of each view and to explain the predictions in an interpretable manner. To address these issues, in this paper, we propose a deep coattention network for multi-view subspace learning, which aims to extract both the common information and the complementary information in an adversarial setting and provide robust interpretations behind the prediction to the end-users via the co-attention mechanism. In particular, it uses a novel cross reconstruction loss and leverages the label information to guide the construction of the latent representation by incorporating the classifier into our model. This improves the quality of latent representation and accelerates the convergence speed. Finally, we develop an efficient iterative algorithm to find the optimal encoders and discriminator, which are evaluated extensively on synthetic and real-world data sets. We also conduct a case study to demonstrate how the proposed method robustly interprets the predictions on an image data set.

Towards Better Uncertainty Sampling: Active Learning With Multiple Views For Deep Convolutional Neural Network

Uncertainty-Based Active Learning Via Sparse Modeling for Image Classification

Uncertainty Sampling Based Active Learning with Diversity Constraint by Sparse Selection.

Deep Co-Attention Network for Multi-View Subspace Learning

An Intelligent Multi-View Active Learning Method Based on a Double-Branch Network

A Cnn-Based Depth Estimation Approach With Multi-Scale Sub-Pixel Convolutions And A Smoothness Constraint

Dataset Refinement for Convolutional Neural Networks via Active Learning.

Uncertainty Quantification via Hölder Divergence for Multi-View Representation Learning

Active Learning for Deep Visual Tracking

Uncertainty-Aware Multi-View Representation Learning

Dual Adversarial Network for Deep Active Learning

Self-supervised Class-Balanced Active Learning with Uncertainty-Mastery Fusion

Deep Active Learning for Remote Sensing Object Detection

Multi-Class Active Learning by Uncertainty Sampling with Diversity Maximization

Uncertainty Aware Active Learning for Reconfiguration of Pre-trained Deep Object-Detection Networks for New Target Domains

Multi-View Active Learning Based on Weighted Hypothesis Boosting and Hierarchical Competition Sampling

Action Recognition for Depth Video using Multi-view Dynamic Images

Deep Active Learning with Noise Stability

Fast Bayesian Uncertainty Estimation and Reduction of Batch Normalized Single Image Super-Resolution Network

Multi-criteria Active Deep Learning for Image Classification

Uncertainty Guided Multi-View Stereo Network for Depth Estimation