Abstract:The random-hidden-node extreme learning machine (ELM) is a much more generalized cluster of single-hidden-layer feed-forward neural networks (SLFNs) which has three parts: random projection, non-linear transformation, and ridge regression (RR) model. Networks with deep architectures have demonstrated state-of-the-art performance in a variety of settings, especially with computer vision tasks. Deep learning algorithms such as stacked autoencoder (SAE) and deep belief network (DBN) are built on learning several levels of representation of the input. Beyond simply learning features by stacking autoencoders (AE), there is a need for increasing its robustness to noise and reinforcing the sparsity of weights to make it easier to discover interesting and prominent features. The sparse AE and denoising AE was hence developed for this purpose. This paper proposes an approach: SSDAE-RR (stacked sparse denoising autoencoder – ridge regression) that effectively integrates the advantages in SAE, sparse AE, denoising AE, and the RR implementation in ELM algorithm. We conducted experimental study on real-world classification (binary and multiclass) and regression problems with different scales among several relevant approaches: SSDAE-RR, ELM, DBN, neural network (NN), and SAE. The performance analysis shows that the SSDAE-RR tends to achieve a better generalization ability on relatively large datasets (large sample size and high dimension) that were not pre-processed for feature abstraction. For 16 out of 18 tested datasets, the performance of SSDAE-RR is more stable than other tested approaches. We also note that the sparsity regularization and denoising mechanism seem to be mandatory for constructing interpretable feature representations. The fact that a SSDAE-RR approach often has a comparable training time to ELM makes it useful in some real applications.

RANSAC Multi Model Response Regression based Pruned Extreme Learning Machines for Multiclass problems

Extreme Learning Machine with Multiple Kernels

Multiple-kernel-learning-based Extreme Learning Machine for Classification Design

Image super-resolution representation via image patches based on extreme learning machine

Fast Sparse Approximation of Extreme Learning Machine

Genetic Ensemble of Extreme Learning Machine

A Fast Incremental Method Based on Regularized Extreme Learning Machine

Noninvasive Reconstruction of Cardiac Transmembrane Potentials Using A Kernelized Extreme Learning Method

Multi-class AdaBoost ELM

A Batch Inheritance Extreme Learning Machine Algorithm Based on Regular Optimization

Correntropy Extreme Learning Machine Based on Spatial Pyramid Matching and Local Receptive Field

ELM-MapReduce: MapReduce Accelerated Extreme Learning Machine for Big Spatial Data Analysis

An Enhanced Extreme Learning Machine Based on Square-Root Lasso Method

Effective Non-Random Extreme Learning Machine

Building Feature Space of Extreme Learning Machine with Sparse Denoising Stacked-Autoencoder.

An extreme learning machine model based on adaptive multi-fusion chaotic sparrow search algorithm for regression and classification

LASSO EXTREME LEARNING MACHINE

Sparse Bayesian ELM Handling with Missing Data for Multi-class Classification

Evolutionary Selection Extreme Learning Machine Optimization for Regression.

A review on extreme learning machine

An accelerated optimization algorithm for the elastic-net extreme learning machine