Abstract:Extreme learning machine (ELM) as an emerging technology has achieved exceptional performance in large-scale settings, and is well suited to binary and multi-class classification, as well as regression tasks. However, existing ELM and its variants predominantly employ single hidden layer feedforward networks, leaving the popular and potentially powerful stacked generalization principle unexploited for seeking predictive deep representations of input data. Deep architectures can find higher-level representations, thus can potentially capture relevant higher-level abstractions. But most of current deep learning methods require solving a difficult and non-convex optimization problem. In this paper, we propose a stacked model, DrELM, to learn deep representations via extreme learning machine according to stacked generalization philosophy. The proposed model utilizes ELM as a base building block and incorporates random shift and kernelization as stacking elements. Specifically, in each layer, DrELM integrates a random projection of the predictions obtained by ELM into the original feature, and then applies kernel functions to generate the resultant feature. To verify the classification and regression performance of DrELM, we conduct the experiments on both synthetic and real-world data sets. The experimental results show that DrELM outperforms ELM and kernel ELMs, which appear to demonstrate that DrELM could yield predictive features that are suitable for prediction tasks. The performances of the deep models (i.e. Stacked Auto-encoder) are comparable. However, due to the utilization of ELM, DrELM is easier to learn and faster in testing.

Densely connected multilayer extreme learning machine algorithms

Densely Connected Deep Extreme Learning Machine Algorithm

Multiple-kernel-learning-based Extreme Learning Machine for Classification Design

Extreme Learning Machine with Multiple Kernels

Extreme Learning Machine Combining Hidden-Layer Feature Weighting and Batch Training for Classification

Extreme Learning Machine with Kernel Model Based on Deep Learning

Optimizing Extreme Learning Machine Via Generalized Hebbian Learning and Intrinsic Plasticity Learning

Laplacian Multi Layer Extreme Learning Machine

Hierarchical Ensemble of Extreme Learning Machine.

An Enhanced Hierarchical Extreme Learning Machine With Random Sparse Matrix Based Autoencoder

Network Embedding Based on Deep Extreme Learning Machine

Densely connected convolutional extreme learning machine for hyperspectral image classification

A Hierarchical Structure of Extreme Learning Machine (HELM) for High-Dimensional Datasets with Noise

Generalized extreme learning machine autoencoder and a new deep neural network.

Non-iterative and Fast Deep Learning: Multilayer Extreme Learning Machines

A Novel Bio-inspired Image Recognition Network with Extreme Learning Machine

Deep Convolutional Representations and Kernel Extreme Learning Machines for Image Classification

Learning deep representations via extreme learning machines.

Remote Sensing Image Scene Classification Based on Densely Connected Multilayer Kernel ELM

Dynamic Adjustment of Hidden Layer Structure for Convex Incremental Extreme Learning Machine