Abstract:The problem of embedding arises in many machine learning applications with the assumption that there may exist a small number of variabilities which can guarantee the "semantics" of the original high-dimensional data. Most of the existing embedding algorithms perform to maintain the locality-preserving property. In this study, inspired by the remarkable success of representation learning and deep learning, we propose a framework of embedding with autoencoder regularization (EAER for short), which incorporates embedding and autoencoding techniques naturally. In this framework, the original data are embedded into the lower dimension, represented by the output of the hidden layer of the autoencoder, thus the resulting data can not only maintain the locality-preserving property but also easily revert to their original forms. This is guaranteed by the joint minimization of the embedding loss and the autoencoder reconstruction error. It is worth mentioning that instead of operating in a batch mode as most of the previous embedding algorithms conduct, the proposed framework actually generates an inductive embedding model and thus supports incremental embedding efficiently. To show the effectiveness of EAER, we adapt this joint learning framework to three canonical embedding algorithms, and apply them to both synthetic and real-world data sets. The experimental results show that the adaption of EAER outperforms its original counterpart. Besides, compared with the existing incremental embedding algorithms, the results demonstrate that EAER performs incremental embedding with more competitive efficiency and effectiveness.

Dimensionality Reduction Strategy Based on Auto-Encoder

Auto-Encoder Based Dimensionality Reduction

Guided autoencoder for dimensionality reduction of pedestrian features

Representation Learning Via a Semi-Supervised Stacked Distance Autoencoder for Image Classification

Generalized Autoencoder: A Neural Network Framework for Dimensionality Reduction

An Automated Data Mining Framework Using Autoencoders for Feature Extraction and Dimensionality Reduction

A restorable autoencoder as a method for dimensionality reduction

An Additive Autoencoder for Dimension Estimation

A Hybrid Autoencoder Framework of Dimensionality Reduction for Brain-Computer Interface Decoding

High Dimensionality Reduction Using Cur Matrix Decomposition And Auto-Encoder For Web Image Classification

A comprehensive survey on design and application of autoencoder in deep learning

Autoencoders with Intrinsic Dimension Constraints for Learning Low Dimensional Image Representations

A NEW TRAINING ALGORITHM OF AUTOENCODER COMBINING LATERAL INHIBITION MECHANISM

Dimension Estimation Using Autoencoders

A Meta-learning Formulation of the Autoencoder Problem for Non-linear Dimensionality Reduction

Reducing Tongue Shape Dimensionality from Hundreds of Available Resources Using Autoencoder

Embedding with Autoencoder Regularization.

Sparse Clustering Algorithm Based on Multi-Domain Dimensionality Reduction Autoencoder

SCDRHA: A scRNA-Seq Data Dimensionality Reduction Algorithm Based on Hierarchical Autoencoder

A New Modal Autoencoder for Functionally Independent Feature Extraction

Research of Stacked Denoising Sparse Autoencoder.