Abstract:The random-hidden-node extreme learning machine (ELM) is a much more generalized cluster of single-hidden-layer feed-forward neural networks (SLFNs) which has three parts: random projection, non-linear transformation, and ridge regression (RR) model. Networks with deep architectures have demonstrated state-of-the-art performance in a variety of settings, especially with computer vision tasks. Deep learning algorithms such as stacked autoencoder (SAE) and deep belief network (DBN) are built on learning several levels of representation of the input. Beyond simply learning features by stacking autoencoders (AE), there is a need for increasing its robustness to noise and reinforcing the sparsity of weights to make it easier to discover interesting and prominent features. The sparse AE and denoising AE was hence developed for this purpose. This paper proposes an approach: SSDAE-RR (stacked sparse denoising autoencoder – ridge regression) that effectively integrates the advantages in SAE, sparse AE, denoising AE, and the RR implementation in ELM algorithm. We conducted experimental study on real-world classification (binary and multiclass) and regression problems with different scales among several relevant approaches: SSDAE-RR, ELM, DBN, neural network (NN), and SAE. The performance analysis shows that the SSDAE-RR tends to achieve a better generalization ability on relatively large datasets (large sample size and high dimension) that were not pre-processed for feature abstraction. For 16 out of 18 tested datasets, the performance of SSDAE-RR is more stable than other tested approaches. We also note that the sparsity regularization and denoising mechanism seem to be mandatory for constructing interpretable feature representations. The fact that a SSDAE-RR approach often has a comparable training time to ELM makes it useful in some real applications.

Encoding Learning Network Combined with Feature Similarity Constraints for Human Action Recognition

Extreme Learning Machine Combining Hidden-Layer Feature Weighting and Batch Training for Classification

A Novel Bio-inspired Image Recognition Network with Extreme Learning Machine

A Novel Biologically Inspired ELM-based Network for Image Recognition

Learning SpatioTemporal and Motion Features in a Unified 2D Network for Action Recognition

Human Action Recognition From Digital Videos Based on Deep Learning.

Human Action Recognition Using Deep Learning Methods.

Optimizing Extreme Learning Machine Via Generalized Hebbian Learning and Intrinsic Plasticity Learning

Extreme learning machine with autoencoding receptive fields for image classification

A resource conscious human action recognition framework using 26-layered deep convolutional neural network

Human Action Recognition Based on Three-Stream Network with Frame Sequence Features

Building Feature Space of Extreme Learning Machine with Sparse Denoising Stacked-Autoencoder.

A Navel Facial Expression Recognition Method Based On Extreme Learning Machine

RGB-D based human action recognition using evolutionary self-adaptive extreme learning machine with knowledge-based control parameters

Dense Semantics-Assisted Networks For Video Action Recognition

Extreme Learning Machine for Linear Dynamical Systems Classification: Application to Human Activity Recognition

DB-LSTM: Densely-connected Bi-directional LSTM for Human Action Recognition

Human action recognition using attention based LSTM network with dilated CNN features

A very deep sequences learning approach for human action recognition

MIE-Net: Motion Information Enhancement Network for Fine-Grained Action Recognition Using RGB Sensors

Multilayer deep features with multiple kernel learning for action recognition