Abstract:The random-hidden-node extreme learning machine (ELM) is a much more generalized cluster of single-hidden-layer feed-forward neural networks (SLFNs) which has three parts: random projection, non-linear transformation, and ridge regression (RR) model. Networks with deep architectures have demonstrated state-of-the-art performance in a variety of settings, especially with computer vision tasks. Deep learning algorithms such as stacked autoencoder (SAE) and deep belief network (DBN) are built on learning several levels of representation of the input. Beyond simply learning features by stacking autoencoders (AE), there is a need for increasing its robustness to noise and reinforcing the sparsity of weights to make it easier to discover interesting and prominent features. The sparse AE and denoising AE was hence developed for this purpose. This paper proposes an approach: SSDAE-RR (stacked sparse denoising autoencoder – ridge regression) that effectively integrates the advantages in SAE, sparse AE, denoising AE, and the RR implementation in ELM algorithm. We conducted experimental study on real-world classification (binary and multiclass) and regression problems with different scales among several relevant approaches: SSDAE-RR, ELM, DBN, neural network (NN), and SAE. The performance analysis shows that the SSDAE-RR tends to achieve a better generalization ability on relatively large datasets (large sample size and high dimension) that were not pre-processed for feature abstraction. For 16 out of 18 tested datasets, the performance of SSDAE-RR is more stable than other tested approaches. We also note that the sparsity regularization and denoising mechanism seem to be mandatory for constructing interpretable feature representations. The fact that a SSDAE-RR approach often has a comparable training time to ELM makes it useful in some real applications.

Chinese News Text Classification of the Stacked Denoising Auto Encoder Based on Adaptive Learning Rate and Additional Momentum Item.

Exploiting SDAE Model for Recommendations

A Label Noise Robust Stacked Auto-Encoder Algorithm for Inaccurate Supervised Classification Problems

Stacked Spatial–Temporal Autoencoder for Quality Prediction in Industrial Processes

Marginalized Denoising Autoencoders for Domain Adaptation

A new Stack Autoencoder: Neighbouring Sample Envelope Embedded Stack Autoencoder Ensemble Model

Hybrid Deep Neural Network Based on SDAE and GRUNN

Stacked Denoising Autoencoders Based Poisson Regression For Count Data Modeling

Financial Market Directional Forecasting With Stacked Denoising Autoencoder

Segmentation-Based Adversarial Denoising Auto-Encoder for Anomaly Detection in Multivariate Time Series Data

Optimizing News Text Classification with Bi-LSTM and Attention Mechanism for Efficient Data Processing

Remote Sensing Image Classification Based on Stacked Denoising Autoencoder

Cross-domain Sentiment Classification Using Deep Learning Approach

Rapid Feature Learning with Stacked Linear Denoisers

Long short-term memory (LSTM)-based news classification model

Wind turbine generator early fault diagnosis using LSTM-based stacked denoising autoencoder network and stacking algorithm

Building Feature Space of Extreme Learning Machine with Sparse Denoising Stacked-Autoencoder.

Denoising Deep Extreme Learning Machine for Sparse Representation

Sediment Classification of Acoustic Backscatter Image Based on Stacked Denoising Autoencoder and Modified Extreme Learning Machine

On building ensembles of stacked denoising auto-encoding classifiers and their further improvement

Rock mass quality classification based on deep learning: A feasibility study for stacked autoencoders