Abstract:Stack autoencoder (SAE), as a representative deep network, has unique and excellent performance in feature learning, and has received extensive attention from researchers. However, existing deep SAEs focus on original samples without considering the hierarchical structural information between samples. To address this limitation, this paper proposes a new SAE model-neighbouring envelope embedded stack autoencoder ensemble (NE_ESAE). Firstly, the neighbouring sample envelope learning mechanism (NSELM) is proposed for preprocessing of input of SAE. NSELM constructs sample pairs by combining neighbouring samples. Besides, the NSELM constructs a multilayer sample spaces by multilayer iterative mean clustering, which considers the similar samples and generates layers of envelope samples with hierarchical structural information. Second, an embedded stack autoencoder (ESAE) is proposed and trained in each layer of sample space to consider the original samples during training and in the network structure, thereby better finding the relationship between original feature samples and deep feature samples. Third, feature reduction and base classifiers are conducted on the layers of envelope samples respectively, and output classification results of every layer of samples. Finally, the classification results of the layers of envelope sample space are fused through the ensemble mechanism. In the experimental section, the proposed algorithm is validated with over ten representative public datasets. The results show that our method significantly has better performance than existing traditional feature learning methods and the representative deep autoencoders.

Stacked Auto-Encoders for Feature Extraction with Neural Networks.

Learning Robust Features with Incremental Auto-Encoders

Stacked Convolutional Denoising Auto-Encoders for Feature Representation

Denoising Auto-Encoders Toward Robust Unsupervised Feature Representation.

A Label Noise Robust Stacked Auto-Encoder Algorithm for Inaccurate Supervised Classification Problems

Representation Learning Via a Semi-Supervised Stacked Distance Autoencoder for Image Classification

Stacked Similarity-Aware Autoencoders.

Stacked Spatial–Temporal Autoencoder for Quality Prediction in Industrial Processes

Stacked What-Where Auto-encoders

Manifold Regularized Stacked Autoencoder for Feature Learning

Training Stacked Denoising Autoencoders for Representation Learning

Stacked Convolutional Sparse Auto-Encoders for Representation Learning

Feature-Aligned Stacked Autoencoder: A Novel Semisupervised Deep Learning Model for Pattern Classification of Industrial Faults

Gated Stacked Target-Related Autoencoder: A Novel Deep Feature Extraction and Layerwise Ensemble Method for Industrial Soft Sensor Application

Stacked autoencoders based machine learning for noise reduction and signal reconstruction in geophysical data

A New Training Principle for Stacked Denoising Autoencoders

Using Deep Autoencoders for Facial Expression Recognition

Dimensionality Reduction Strategy Based on Auto-Encoder

Stacked Autoencoders for Medical Image Search

Stack Multiple Shallow Autoencoders into a Strong One: A New Reconstruction-Based Method to Detect Anomaly

A new Stack Autoencoder: Neighbouring Sample Envelope Embedded Stack Autoencoder Ensemble Model