Abstract:Deep learning is a kind of feature learning method with strong nonliear feature transformation and becomes more and more important in many fields of artificial intelligence. Deep autoencoder is one representative method of the deep learning methods, and can effectively extract abstract the information of datasets. However, it does not consider the complementarity between the deep features and original features during deep feature transformation. Besides, it suffers from small sample problem. In order to solve these problems, a novel deep autoencoder - hybrid feature embedded stacked sparse autoencoder(HESSAE) has been proposed in this paper. HFESAE is capable to learn discriminant deep features with the help of embedding original features to filter weak hidden-layer outputs during training. For the issue that class representation ability of abstract information is limited by small sample problem, a feature fusion strategy has been designed aiming to combining abstract information learned by HFESAE with original feature and obtain hybrid features for feature reduction. The strategy is hybrid feature selection strategy based on L1 regularization followed by an support vector machine(SVM) ensemble model, in which weighted local discriminant preservation projection (w_LPPD), is designed and employed on each base classifier. At the end of this paper, several representative public datasets are used to verify the effectiveness of the proposed algorithm. The experimental results demonstrated that, the proposed feature learning method yields superior performance compared to other existing and state of art feature learning algorithms including some representative deep autoencoder methods.

Deep Feature Representation via Multiple Stack Auto-Encoders.

Stacked Spatial–Temporal Autoencoder for Quality Prediction in Industrial Processes

Representation Learning Via a Semi-Supervised Stacked Distance Autoencoder for Image Classification

Gated Stacked Target-Related Autoencoder: A Novel Deep Feature Extraction and Layerwise Ensemble Method for Industrial Soft Sensor Application

Diversified feature representation via deep auto-encoder ensemble through multiple activation functions

A new Stack Autoencoder: Neighbouring Sample Envelope Embedded Stack Autoencoder Ensemble Model

Deep EEG feature learning via stacking common spatial pattern and support matrix machine

Denoising Auto-Encoders Toward Robust Unsupervised Feature Representation.

Stacked What-Where Auto-encoders

Novel Segmented Stacked Autoencoder for Effective Dimensionality Reduction and Feature Extraction in Hyperspectral Imaging

Stacked Convolutional Denoising Auto-Encoders for Feature Representation

Hybrid Embedded Deep Stacked Sparse Autoencoder with w_LPPD SVM Ensemble

Information Complementary Fusion Stacked Autoencoders for Soft Sensor Applications in Multimode Industrial Processes

Stack Multiple Shallow Autoencoders into a Strong One: A New Reconstruction-Based Method to Detect Anomaly

Feature-Aligned Stacked Autoencoder: A Novel Semisupervised Deep Learning Model for Pattern Classification of Industrial Faults

Stacked Dual-Guided Autoencoder: A Scalable Deep Latent Variable Model for Semi-Supervised Industrial Soft Sensing

Stacked Convolutional Sparse Auto-Encoders for Representation Learning

Stacked Auto-Encoders for Feature Extraction with Neural Networks.

Single Sample Face Recognition Via Learning Deep Supervised Autoencoders

Stacked Convolutional Deep Encoding Network for Video-Text Retrieval.

Manifold Regularized Stacked Autoencoder for Feature Learning