Abstract:The application of Auto-Encoder (AE) to multi-view representation learning has gained traction due to advancements in deep learning. While some current AE-based multi-view representation learning algorithms incorporate the geometric structure of the input data into their feature representation learning process, their use of a shallow structured graph regularization term can be restrictive when used in conjunction with deep models. Furthermore, current multi-view representation learning algorithms do not fully utilize the diversity and consistency presented in different views, leading to a reduction in the efficacy of feature learning. This paper introduces a novel approach, reconstructed graph constrained auto-encoders (RGCAE), for multi-view representation learning. Unlike existing methods, our approach incorporates deep adaptive graph regularization based on multi-layer perceptron to ensure the preservation of the geometric similarity graph, which is constructed based on the local invariance principle. By decoupling the feature representation learning from the preservation of the geometric structure among different views, our approach can better leverage the diversity presented in multi-view data. We obtain view-specific representations that preserve the geometric structure and then combine them by averaging to obtain a common representation. To ensure the consistency of the multi-view data, we minimize the loss between the view-specific and common representations. Consequently, our RGCAE approach can maintain the geometric structure of multi-view data and is better suited for integration with deep models. Extensive experiments on six datasets demonstrate that RGCAE obtained promising performance, compared with the state-of-the-art methods.

Chart Auto-Encoders for Manifold Structured Data

Semi-Supervised Manifold Learning with Complexity Decoupled Chart Autoencoders

Deep Nonparametric Estimation of Intrinsic Data Structures by Chart Autoencoders: Generalization Error and Robustness

Deep Manifold Computing and Visualization

Latent Space Characterization of Autoencoder Variants

Extendable and invertible manifold learning with geometry regularized autoencoders

Semi-supervised Auto-Encoder Based on Manifold Learning

Deep Manifold Graph Auto-Encoder for Attributed Graph Embedding

Encoded Prior Sliced Wasserstein AutoEncoder for learning latent manifold representations

Graph Regularized Auto-Encoders for Image Representation

Autoencoders for discovering manifold dimension and coordinates in data from complex dynamical systems

Autoencoding topology

Manifold Fitting with CycleGAN.

Reconstructed Graph Constrained Auto-Encoders for Multi-View Representation Learning

Manifold Learning by Mixture Models of VAEs for Inverse Problems

Generalized Autoencoder: A Neural Network Framework for Dimensionality Reduction

Geometry-Aware Generative Autoencoders for Warped Riemannian Metric Learning and Generative Modeling on Data Manifolds

Manifold learning about novel continuous autoencoder network

Benign Autoencoders

Stacked Wasserstein Autoencoder