Abstract:In many real-world applications, an object can be described from multiple views or styles, leading to the emerging multi-view analysis. To eliminate the complicated (usually highly nonlinear) view discrepancy for favorable cross-view recognition and retrieval, we propose a Multi-view Linear Discriminant Analysis Network (MvLDAN) by seeking a nonlinear discriminant and view-invariant representation shared among multiple views. Unlike existing multi-view methods which directly learn a common space to reduce the view gap, our MvLDAN employs multiple feedforward neural networks (one for each view) and a novel eigenvalue-based multi-view objective function to encapsulate as much discriminative variance as possible into all the available common feature dimensions. With the proposed objective function, the MvLDAN could produce representations possessing: 1) low variance within the same class regardless of view discrepancy, 2) high variance between different classes regardless of view discrepancy, and 3) high covariance between any two views. In brief, in the learned multi-view space, the obtained deep features can be projected into a latent common space in which the samples from the same class are as close to each other as possible (even though they are from different views), and the samples from different classes are as far from each other as possible (even though they are from the same view). The effectiveness of the proposed method is verified by extensive experiments carried out on five databases, in comparison with the 19 state-of-the-art approaches.

Multi-view uncorrelated linear discriminant analysis with applications to handwritten digit recognition

Multi-View Analysis Dictionary Learning for Image Classification.

Multi-View Correlated Feature Learning by Uncovering Shared Component.

Discriminative Sparse Generalized Canonical Correlation Analysis (DSGCCA)

Discriminant Learning Through Multiple Principal Angles for Visual Recognition

A Dynamic Discriminative Canonical Correlation Analysis via Adaptive Weight Scheme

Sparse Additive Discriminant Canonical Correlation Analysis for Multiple Features Fusion

Face recognition using uncorrelated, weighted linear discriminant analysis

Canonical Correlation Analysis (CCA) Based Multi-View Learning: An Overview

Multi-View Linear Discriminant Analysis Network.

Laplacian multiset canonical correlations for multiview feature extraction and image recognition

Multi-view Common Component Discriminant Analysis for Cross-view Classification

Robust Multi-view Common Component Learning.

Local Feature Based Multi-View Discriminant Analysis

Linear Discriminant Multi-Set Canonical Correlations Analysis (LDMCCA): an Efficient Approach for Feature Fusion of Finger Biometrics.

Discriminative Multiple Canonical Correlation Analysis for Information Fusion

Dimensionality Reduction by Locally Linear Discriminant Analysis for Handwritten Chinese Character Recognition.

A Novel Multi-View Dimensionality Reduction and Recognition Framework with Applications to Face Recognition.

Nonnegative Constrained Graph Based Canonical Correlation Analysis for Multi-view Feature Learning

Kernel Uncorrelated Discriminant Analysis and Its Application to Handwritten Character Recognition

Feature Extraction By Locality-Based Linear Discriminant Analysis