Abstract:Traditional extreme learning machine (ELM) has random weights between input layer and hidden layer, this kind of random feature mapping brings non-discriminative feature space and unstable classification accuracy, which greatly limits the performance of the ELM networks. Therefore, to get the well-pleasing input weights, two biologically inspired, unsupervised learning methods were introduced to optimize the traditional ELM networks, namely the generalized hebbian algorithm (GHA) and intrinsic plasticity learning (IPL). The GHA is able to extract the principal components of the input data of arbitrary size, while the IPL tunes the probability density of the neuron’s output towards a desired distribution such as exponential distribution or weber distribution, thereby maximizing the networks information transmission. With the incorporation of the GHA and IPL approach, the optimized ELM networks generates a discriminative feature space and preserves much more characteristic of the input data, accordingly, achieving a better task performance. Based on the above two unsupervised methods, a simple, yet effective hierarchical feature mapping extreme learning machine (HFMELM) is further proposed. With almost no information loss in the layer-wise feature mapping process, the HFMELM is able to learn the high-level representation of the input data. To evaluate the effectiveness of the proposed methods, extensive experiments on several datasets are presented, the results show that the proposed methods significantly outperform the traditional ELM networks.

A robust learning algorithm for the extended AM neural network

Speech recognition by using the Extended Associative Memory Neural Network (EAMNN)

A neuron-weighted learning algorithm and its hardware implementation in associative memories

A Batch Inheritance Extreme Learning Machine Algorithm Based on Regular Optimization

Sparse Bayesian Approach to Fast Learning Network for Multiclassification.

Neural network noisy speech recognition and understanding with information feedback

Optimizing Extreme Learning Machine Via Generalized Hebbian Learning and Intrinsic Plasticity Learning

An Improved Brain-Inspired Emotional Learning Algorithm for Fast Classification

A Novel Bio-inspired Image Recognition Network with Extreme Learning Machine

Optimum associative neural network utilizing maximum likelihood

Dendritic Neuron Model with Effective Learning Algorithms for Classification, Approximation, and Prediction

An Improved Algorithm for Eleman Neural Network by Adding a Modified Error Function

Multi-parallel Extreme Learning Machine with Excitatory and Inhibitory Neurons for Regression.

Bidirectional Associative Memory Utilizing Maximum Likelihood

An Algorithm Of Supervised Learning For Elman Neural Network

The adaptive ensemble of OP-ELM using forward-backward selection

A Gegenbauer Neural Network with Regularized Weights Direct Determination for Classification

Tuning extreme learning machine by an improved electromagnetism-like mechanism algorithm for classification problem.

Extreme Learning Machine With Adaptive Growth Of Hidden Nodes And Incremental Updating Of Output Weights

Anefficient Learning Algorithm For Binary Feedforward Neural Networks

A Brain Network Inspired Algorithm: Pre-trained Extreme Learning Machine