Abstract:Traditional extreme learning machine (ELM) has random weights between input layer and hidden layer, this kind of random feature mapping brings non-discriminative feature space and unstable classification accuracy, which greatly limits the performance of the ELM networks. Therefore, to get the well-pleasing input weights, two biologically inspired, unsupervised learning methods were introduced to optimize the traditional ELM networks, namely the generalized hebbian algorithm (GHA) and intrinsic plasticity learning (IPL). The GHA is able to extract the principal components of the input data of arbitrary size, while the IPL tunes the probability density of the neuron’s output towards a desired distribution such as exponential distribution or weber distribution, thereby maximizing the networks information transmission. With the incorporation of the GHA and IPL approach, the optimized ELM networks generates a discriminative feature space and preserves much more characteristic of the input data, accordingly, achieving a better task performance. Based on the above two unsupervised methods, a simple, yet effective hierarchical feature mapping extreme learning machine (HFMELM) is further proposed. With almost no information loss in the layer-wise feature mapping process, the HFMELM is able to learn the high-level representation of the input data. To evaluate the effectiveness of the proposed methods, extensive experiments on several datasets are presented, the results show that the proposed methods significantly outperform the traditional ELM networks.

A novel self-adaptive extreme learning machine based on affinity propagation for radial basis function neural network

Extreme Learning Machine with Multiple Kernels

A Fast Incremental Method Based on Regularized Extreme Learning Machine

A Novel Reformulated Radial Basis Function Neural Network

Multi-label Learning Model Based on Multi-label Radial Basis Function Neural Network and Regularized Extreme Learning Machine

A Batch Inheritance Extreme Learning Machine Algorithm Based on Regular Optimization

Self-adaptive Extreme Learning Machine Optimized by Rough Set Theory and Affinity Propagation Clustering

Intelligent Optimization Strategy for ELM-RBF Neural Networks

An Adaptive Extreme Learning Machine Algorithm and Its Application on Face Recognition

Rough RBF Neural Network Based on Extreme Learning

Optimizing Radial Basis Function Neural Network Based on Rough Sets and Affinity Propagation Clustering Algorithm

A Rough RBF Neural Network Based on Weighted Regularized Extreme Learning Machine

Optimizing Extreme Learning Machine Via Generalized Hebbian Learning and Intrinsic Plasticity Learning

Multi-label Learning Method Based on ML-RBF and Laplacian ELM

Distributed Extreme Learning Machine for Nonlinear Learning over Network

Function Approximation Based on Self-Adaptive RBF Neural Network with Combined Clustering Algorithm

A study on effectiveness of extreme learning machine

Incremental Extreme Learning Machine Based on Deep Feature Embedded

A Novel Extreme Learning Machine Based on Hybrid Kernel Function.

Extreme Learning Machine With Adaptive Growth Of Hidden Nodes And Incremental Updating Of Output Weights

Extreme learning machine: algorithm, theory and applications