Abstract:In many computer vision applications, an object can be represented by multiple different views. Due to the heterogeneous gap triggered by the different views' inconsistent distributions, it is challenging to exploit these multiview data for cross-view retrieval and classification. Motivated by the fact that both labeled and unlabeled data can enhance the relations among different views, this article proposes a deep cross-view learning framework called deep semisupervised classes- and correlation-collapsed cross-view learning (DSC3L) for cross-view retrieval and classification. Different from the existing methods which focus on the two-view problems, the proposed method learns U (generally U ≥ 2 ) view-specific deep transformations to gradually project U different views into a shared space in which the projection embraces the supervised learning and the unsupervised learning. We propose collapsing the instances of the same class from all views into the same point, with the instances of different classes into distinct points simultaneously. Second, to exploit the abundant unlabeled U -wise multiview data, we propose to collapse-correlated data into the same point, with the uncorrelated data into distinct points. Specifically, these two processes are formulated to minimize the two Kullback-Leibler (KL) divergences between the conditional distribution and a desirable one, for each instance. Finally, the two KL divergences are integrated into a joint optimization to learn a discriminative shared space. The experimental results on five widely used public datasets demonstrate the effectiveness of the proposed method.

Novel Semisupervised High-Dimensional Correspondences Learning Method

Learning Visually Aligned Semantic Graph for Cross-Modal Manifold Matching.

Learning High Dimensional Correspondences Based on Maximum Variance Unfolding

Learning High-Dimensional Correspondence Via Manifold Learning and Local Approximation

Semisupervised Manifold Learning For Color Transfer Between Multiview Images

A Regularized Approach for Geodesic-Based Semisupervised Multimanifold Learning

Manifold Alignment Via Corresponding Projections.

Unsupervised Feature Learning for Dense Correspondences Across Scenes

A Supervised Manifold Learning Method

Semi-supervised Discriminant Isomap with Application to Visualization, Image Retrieval and Classification

Unsupervised image matching based on manifold alignment.

Deep Semisupervised Class- and Correlation-Collapsed Cross-View Learning

Semi-supervised LDA Based Method for Similarity Distance Metric Learning.

Descriptor Ensemble: An Unsupervised Approach to Descriptor Fusion in the Homography Space

Unsupervised Iterative Manifold Alignment Via Local Feature Histograms

Match me if you can: Semi-Supervised Semantic Correspondence Learning with Unpaired Images

Integrating Efficient Optimal Transport and Functional Maps For Unsupervised Shape Correspondence Learning

Spectral Methods for Semi-Supervised Manifold Learning.

Dimension Reduction with Semi-supervised Pairwise Covariance-Preserving Projection

Spatial-then-Temporal Self-Supervised Learning for Video Correspondence.

Weakly Supervised Learning of Semantic Correspondence Through Cascaded Online Correspondence Refinement