Abstract:Stack autoencoder (SAE), as a representative deep network, has unique and excellent performance in feature learning, and has received extensive attention from researchers. However, existing deep SAEs focus on original samples without considering the hierarchical structural information between samples. To address this limitation, this paper proposes a new SAE model-neighbouring envelope embedded stack autoencoder ensemble (NE_ESAE). Firstly, the neighbouring sample envelope learning mechanism (NSELM) is proposed for preprocessing of input of SAE. NSELM constructs sample pairs by combining neighbouring samples. Besides, the NSELM constructs a multilayer sample spaces by multilayer iterative mean clustering, which considers the similar samples and generates layers of envelope samples with hierarchical structural information. Second, an embedded stack autoencoder (ESAE) is proposed and trained in each layer of sample space to consider the original samples during training and in the network structure, thereby better finding the relationship between original feature samples and deep feature samples. Third, feature reduction and base classifiers are conducted on the layers of envelope samples respectively, and output classification results of every layer of samples. Finally, the classification results of the layers of envelope sample space are fused through the ensemble mechanism. In the experimental section, the proposed algorithm is validated with over ten representative public datasets. The results show that our method significantly has better performance than existing traditional feature learning methods and the representative deep autoencoders.

Discriminative Stacked Autoencoder for Feature Representation and Classification.

Representation Learning Via a Semi-Supervised Stacked Distance Autoencoder for Image Classification

Gated Stacked Target-Related Autoencoder: A Novel Deep Feature Extraction and Layerwise Ensemble Method for Industrial Soft Sensor Application

A Label Noise Robust Stacked Auto-Encoder Algorithm for Inaccurate Supervised Classification Problems

Stacked Spatial–Temporal Autoencoder for Quality Prediction in Industrial Processes

Variational Discriminative Stacked Auto-Encoder: Feature Representation Using a Prelearned Discriminator, and Its Application to Industrial Process Monitoring

Feature-Aligned Stacked Autoencoder: A Novel Semisupervised Deep Learning Model for Pattern Classification of Industrial Faults

Gated Quality-Driven Feature Extraction with A Hybrid SIAE Model for Industrial Soft Sensor

Deep Learning for Fault-Relevant Feature Extraction and Fault Classification with Stacked Supervised Auto-Encoder

Discriminative Stacked Autoencoder: Feature-Integration Boosting for Bearing Fault Diagnosis

Novel Segmented Stacked Autoencoder for Effective Dimensionality Reduction and Feature Extraction in Hyperspectral Imaging

Stacked Dual-Guided Autoencoder: A Scalable Deep Latent Variable Model for Semi-Supervised Industrial Soft Sensing

A new Stack Autoencoder: Neighbouring Sample Envelope Embedded Stack Autoencoder Ensemble Model

Semisupervised Stacked Autoencoder with Cotraining for Hyperspectral Image Classification.

Fault Diagnosis With Feature Representation Based On Stacked Sparse Auto Encoder

Stacked Attention-based Autoencoder with Feature Fusion and Its Application for Quality Prediction

Learning Compact and Discriminative Stacked Autoencoder for Hyperspectral Image Classification

Stacked supervised auto-encoder with graph regularization for feature extraction and fault classification in chemical processes

Rolling Element Bearing Fault Classification Using Improved Stacked De-noising Auto-encoders

Stacked Face De-Noising Auto Encoders for Expression-Robust Face Recognition

Stacked Convolutional Sparse Auto-Encoders for Representation Learning