Abstract:Traditional extreme learning machine (ELM) has random weights between input layer and hidden layer, this kind of random feature mapping brings non-discriminative feature space and unstable classification accuracy, which greatly limits the performance of the ELM networks. Therefore, to get the well-pleasing input weights, two biologically inspired, unsupervised learning methods were introduced to optimize the traditional ELM networks, namely the generalized hebbian algorithm (GHA) and intrinsic plasticity learning (IPL). The GHA is able to extract the principal components of the input data of arbitrary size, while the IPL tunes the probability density of the neuron’s output towards a desired distribution such as exponential distribution or weber distribution, thereby maximizing the networks information transmission. With the incorporation of the GHA and IPL approach, the optimized ELM networks generates a discriminative feature space and preserves much more characteristic of the input data, accordingly, achieving a better task performance. Based on the above two unsupervised methods, a simple, yet effective hierarchical feature mapping extreme learning machine (HFMELM) is further proposed. With almost no information loss in the layer-wise feature mapping process, the HFMELM is able to learn the high-level representation of the input data. To evaluate the effectiveness of the proposed methods, extensive experiments on several datasets are presented, the results show that the proposed methods significantly outperform the traditional ELM networks.

A Modified Fast Recursive Hidden Nodes Selection Algorithm For Elm

A Fast Incremental Method Based on Regularized Extreme Learning Machine

Extreme Learning Machine with Multiple Kernels

Genetic Ensemble of Extreme Learning Machine

Fast Sparse Approximation of Extreme Learning Machine

Self-adaptive Extreme Learning Machine Optimized by Rough Set Theory and Affinity Propagation Clustering

A Modified ELM Algorithm for Single-Hidden Layer Feedforward Neural Networks with Linear Nodes

A Fast Training Algorithm for Extreme Learning Machine Based on Matrix Decomposition.

Extreme Learning Machine With Adaptive Growth Of Hidden Nodes And Incremental Updating Of Output Weights

A Novel Learning Algorithm of Single-Hidden-layer Feedforward Neural Networks

Dynamic Adjustment of Hidden Node Parameters for Extreme Learning Machine

A study on effectiveness of extreme learning machine

Extreme learning machine: algorithm, theory and applications

Parsimonious Extreme Learning Machine Using Recursive Orthogonal Least Squares.

Larsen-elm

Optimizing Extreme Learning Machine Via Generalized Hebbian Learning and Intrinsic Plasticity Learning

Selecting the Optimal Hidden Layer of Extreme Learning Machine Using Multiple Kernel Learning.

A Novel Biologically Inspired ELM-based Network for Image Recognition

Evolutionary Selection Extreme Learning Machine Optimization for Regression.

Efficient Inverse-Free Incremental and Decremental Algorithms for Multiple Hidden Nodes in Extreme Learning Machine

A Novel Extreme Learning Machine Based on Hybrid Kernel Function.