Abstract:Domain adaptation (DA), a particular case of transfer learning, is an effective technology for learning a discriminative model in scenarios where the data from the training (source) and the testing (target) domains share common class labels but follow different distributions. The differences between domains, called domain shifts, are caused by variations in the acquisition devices and environmental conditions, such as changing illuminations, pose, and collecting-device noises, that are related to a specific domain, denoted as domain-specific noises in this paper. The research on stacked denoising autoencoder (SDA) has demonstrated that noise-robust features could be learned through training a model to reduce the man-made (simulated) noises. However, little research has been conducted to learn the domain-invariant features through training SDA to reduce the domain-specific noises from the real word. In this paper, we propose a novel variant of SDA for DA, called the stacked local constraint auto-encoder (SLC-AE), which aims to learn domain-invariant features through iteratively optimizing the SDA and the low-dimensional manifold. The core idea behind the SLC-AE is that both the source and target samples are corrupted due to the domain-specific noises, and each corrupted sample could be de-noised by calculating the weighted sum of its neighbor samples defined on the intrinsic manifold. Because the neighbor samples on the intrinsic manifold are semantically similar, their weighted sum preserves the generic information and reduces the domain-specific noises. To properly evaluate the performance of the SLC-AE, we conducted extensive experiments using seven benchmark data sets, i.e., MNIST, USPS, COIL20, SYN SIGNS, GTSRB, MSRC and VOC 2007. Compared to twelve different state-of-the-art methods, the experimental results demonstrated that the proposed SLC-AE model made significant improvement over the performance of SDA and achieved the best average performance on the seven data sets.

LiSSA: Localized Stochastic Sensitive Autoencoders

A Label Noise Robust Stacked Auto-Encoder Algorithm for Inaccurate Supervised Classification Problems

Latent space configuration for improved generalization in supervised autoencoder neural networks

Stochastic Sensitivity Regularized Autoencoder for Robust Feature Learning

Domain Adaptation by Stacked Local Constraint Auto-Encoder Learning

Linear Local Tangent Space Alignment with Autoencoder

Stacked sparse autoencoders that preserve the local and global feature structures for fault detection

Robust and structural sparsity auto-encoder with L21-norm minimization

A new Stack Autoencoder: Neighbouring Sample Envelope Embedded Stack Autoencoder Ensemble Model

Multi-Localized Sensitive Autoencoder-Attention-LSTM for Skeleton-based Action Recognition

Deep Autoencoder with Localized Stochastic Sensitivity for Short-Term Load Forecasting

Locality-Constrained Sparse Auto-Encoder for Image Classification

An Iterative Stacked Weighted Auto-Encoder

Robust Angular Local Descriptor Learning

ABAE: Auxiliary Balanced AutoEncoder for class-imbalanced semi-supervised learning

A Semi-Supervised Stacked Autoencoder Using the Pseudo Label for Classification Tasks

Embedding with Autoencoder Regularization.

Building Feature Space of Extreme Learning Machine with Sparse Denoising Stacked-Autoencoder.

Improved AutoEncoder with LSTM module and KL divergence

L2G Auto-encoder

Hybrid Embedded Deep Stacked Sparse Autoencoder with w_LPPD SVM Ensemble