Abstract:Traditional extreme learning machine (ELM) has random weights between input layer and hidden layer, this kind of random feature mapping brings non-discriminative feature space and unstable classification accuracy, which greatly limits the performance of the ELM networks. Therefore, to get the well-pleasing input weights, two biologically inspired, unsupervised learning methods were introduced to optimize the traditional ELM networks, namely the generalized hebbian algorithm (GHA) and intrinsic plasticity learning (IPL). The GHA is able to extract the principal components of the input data of arbitrary size, while the IPL tunes the probability density of the neuron’s output towards a desired distribution such as exponential distribution or weber distribution, thereby maximizing the networks information transmission. With the incorporation of the GHA and IPL approach, the optimized ELM networks generates a discriminative feature space and preserves much more characteristic of the input data, accordingly, achieving a better task performance. Based on the above two unsupervised methods, a simple, yet effective hierarchical feature mapping extreme learning machine (HFMELM) is further proposed. With almost no information loss in the layer-wise feature mapping process, the HFMELM is able to learn the high-level representation of the input data. To evaluate the effectiveness of the proposed methods, extensive experiments on several datasets are presented, the results show that the proposed methods significantly outperform the traditional ELM networks.

Improved Adaptive Incremental Error-Minimization-Based Extreme Learning Machine With Localized Generalization Error Model

A Fast Incremental Method Based on Regularized Extreme Learning Machine

Extreme Learning Machine with Multiple Kernels

Genetic Ensemble of Extreme Learning Machine

Extreme Learning Machine With Adaptive Growth Of Hidden Nodes And Incremental Updating Of Output Weights

Multiple-kernel-learning-based Extreme Learning Machine for Classification Design

A Batch Inheritance Extreme Learning Machine Algorithm Based on Regular Optimization

Training an Extreme Learning Machine by Localized Generalization Error Model

Incremental regularized extreme learning machine and it's enhancement.

Optimizing Extreme Learning Machine Via Generalized Hebbian Learning and Intrinsic Plasticity Learning

An Extreme Learning Machine Based on Artificial Immune System.

Optimal Weighted Extreme Learning Machine for Imbalanced Learning with Differential Evolution [research Frontier]

Multi-class AdaBoost ELM

Universal Approximation of Extreme Learning Machine With Adaptive Growth of Hidden Nodes.

A study on effectiveness of extreme learning machine

Improved Convex Incremental Extreme Learning Machine Based on Enhanced Random Search

A Kind of Parameters Self-adjusting Extreme Learning Machine

Incremental and Decremental Extreme Learning Machine Based on Generalized Inverse

Dynamic Adjustment of Hidden Node Parameters for Extreme Learning Machine

Extreme learning machine: algorithm, theory and applications

A Novel Extreme Learning Machine Based on Hybrid Kernel Function.