Abstract:Traditional extreme learning machine (ELM) has random weights between input layer and hidden layer, this kind of random feature mapping brings non-discriminative feature space and unstable classification accuracy, which greatly limits the performance of the ELM networks. Therefore, to get the well-pleasing input weights, two biologically inspired, unsupervised learning methods were introduced to optimize the traditional ELM networks, namely the generalized hebbian algorithm (GHA) and intrinsic plasticity learning (IPL). The GHA is able to extract the principal components of the input data of arbitrary size, while the IPL tunes the probability density of the neuron’s output towards a desired distribution such as exponential distribution or weber distribution, thereby maximizing the networks information transmission. With the incorporation of the GHA and IPL approach, the optimized ELM networks generates a discriminative feature space and preserves much more characteristic of the input data, accordingly, achieving a better task performance. Based on the above two unsupervised methods, a simple, yet effective hierarchical feature mapping extreme learning machine (HFMELM) is further proposed. With almost no information loss in the layer-wise feature mapping process, the HFMELM is able to learn the high-level representation of the input data. To evaluate the effectiveness of the proposed methods, extensive experiments on several datasets are presented, the results show that the proposed methods significantly outperform the traditional ELM networks.

Length-Changeable Incremental Extreme Learning Machine

A Fast Incremental Method Based on Regularized Extreme Learning Machine

Extreme Learning Machine with Multiple Kernels

Genetic Ensemble of Extreme Learning Machine

Multiple-kernel-learning-based Extreme Learning Machine for Classification Design

Extreme Learning Machine With Adaptive Growth Of Hidden Nodes And Incremental Updating Of Output Weights

Robust incremental extreme learning machine

An Improved Algorithm for Incremental Extreme Learning Machine

Incremental regularized extreme learning machine and it's enhancement.

Improved Adaptive Incremental Error-Minimization-Based Extreme Learning Machine With Localized Generalization Error Model

Incremental Constructive Extreme Learning Machine

Dynamic Adjustment of Hidden Layer Structure for Convex Incremental Extreme Learning Machine

Optimizing Extreme Learning Machine Via Generalized Hebbian Learning and Intrinsic Plasticity Learning

Incremental Extreme Learning Machine Based on Deep Feature Embedded

Improvement Algorithm of an Incremental Extreme Learning Machine

Improved Convex Incremental Extreme Learning Machine Based on Enhanced Random Search

Universal Approximation of Extreme Learning Machine With Adaptive Growth of Hidden Nodes.

Two-stage Extreme Learning Machine for Regression.

Dense Incremental Extreme Learning Machine with Accelerating Amount and Proportional Integral Differential

A Novel Kernel-based Extreme Learning Machine with Incremental Hidden Layer Nodes

An Incremental Extreme Learning Machine for Online Sequential Learning Problems