Abstract:Traditional extreme learning machine (ELM) has random weights between input layer and hidden layer, this kind of random feature mapping brings non-discriminative feature space and unstable classification accuracy, which greatly limits the performance of the ELM networks. Therefore, to get the well-pleasing input weights, two biologically inspired, unsupervised learning methods were introduced to optimize the traditional ELM networks, namely the generalized hebbian algorithm (GHA) and intrinsic plasticity learning (IPL). The GHA is able to extract the principal components of the input data of arbitrary size, while the IPL tunes the probability density of the neuron’s output towards a desired distribution such as exponential distribution or weber distribution, thereby maximizing the networks information transmission. With the incorporation of the GHA and IPL approach, the optimized ELM networks generates a discriminative feature space and preserves much more characteristic of the input data, accordingly, achieving a better task performance. Based on the above two unsupervised methods, a simple, yet effective hierarchical feature mapping extreme learning machine (HFMELM) is further proposed. With almost no information loss in the layer-wise feature mapping process, the HFMELM is able to learn the high-level representation of the input data. To evaluate the effectiveness of the proposed methods, extensive experiments on several datasets are presented, the results show that the proposed methods significantly outperform the traditional ELM networks.

Constructive Hidden Nodes Selection of Extreme Learning Machine for Regression

Genetic Ensemble of Extreme Learning Machine

Extreme Learning Machine with Multiple Kernels

Evolutionary Selection Extreme Learning Machine Optimization for Regression.

Dynamic Adjustment of Hidden Node Parameters for Extreme Learning Machine

A Modified Fast Recursive Hidden Nodes Selection Algorithm For Elm

Constructive model selection for multi-output extreme learning machine

Extreme Learning Machine With Adaptive Growth Of Hidden Nodes And Incremental Updating Of Output Weights

Ensemble Delta Test-Extreme Learning Machine (Dt-Elm) for Regression

Optimization Approximation Solution for Regression Problem Based on Extreme Learning Machine

Effective Non-Random Extreme Learning Machine

An optimization method of extreme learning machine for regression.

A Deep and Stable Extreme Learning Approach for Classification and Regression

Selecting the Optimal Hidden Layer of Extreme Learning Machine Using Multiple Kernel Learning.

Parsimonious Extreme Learning Machine Using Recursive Orthogonal Least Squares.

A Pruning Ensemble Model of Extreme Learning Machine with $$L_{1/2}$$L1/2 Regularizer

A study on effectiveness of extreme learning machine

LASSO EXTREME LEARNING MACHINE

An enhanced extreme learning machine based on ridge regression for regression

Optimizing Extreme Learning Machine Via Generalized Hebbian Learning and Intrinsic Plasticity Learning

The adaptive ensemble of OP-ELM using forward-backward selection