Abstract:It is clear that the learning speed of feedforward neural networks is in general far slower than required and it has been a major bottleneck in their applications for past decades. Two key reasons behind may be: 1) the slow gradient-based learning algorithms are extensively used to train neural networks, and 2) all the parameters of the networks are tuned iteratively by using such learning algorithms. Unlike these traditional implementations, this paper proposes a new learning algorithm called extreme learning machine (ELM) for single-hidden layer feedforward neural networks (SLFNs) which randomly chooses the input weights and analytically determines the output weights of SLFNs. In theory, this algorithm tends to provide the best generalization performance at extremely fast learning speed. The experimental results based on real-world benchmarking function approximation and classification problems including large complex applications show that the new algorithm can produce best generalization performance in some cases and can learn much faster than traditional popular learning algorithms for feedforward neural networks.

A Fast Learning Algorithm of Feedforward Neural Networks by Using Novel Error Functions

A Fast Learning Algorithm of Neural Networks by Changing Error Functions

Fast Learning Algorithms for Feedforward Neural Networks

Dynamic node creation and fast learning algorithm for a hybrid feedforward neural network

A Fast Learning Algorithm for Feedfoward Neural Network Based on the Layer-by-Layer and Neuron-by-Neuron Optimizing Procedure

Optimal Algorithm for a Multilayer Feedforward Net and Its Application

A Novel Global Hybrid Algorithm for Feedforward Neural Networks

A Novel Fuzzy Neural Network with Fast Training and Accurate Generalization.

An Algorithm for Fast Convergence of Back Propagation by Enlarging Error

A novel fuzzy neural network with fast training anal accurate generalization

Fast Learning Network: a Novel Artificial Neural Network with a Fast Learning Speed

Convergence of Batch Gradient Method Based on the Entropy Error Function for Feedforward Neural Networks

A Fast Hybrid Algorithm Of Global Optimization For Feedforward Neural Networks

A Fast Learning Strategy For Multilayer Feedforward Neural Networks

Extreme Learning Machine: A New Learning Scheme of Feedforward Neural Networks

Feedback control standpoint based fast training approach of neural networks and its application

Adaptive Algorithm of Learning Rate for Feedforward Neural Network

A Novel Rbf Neural Network With Fast Training And Accurate Generalization

A New Layer-Wise Linearized Algorithm for Feedforward Neural Network

Optimal filtering algorithms for fast learning in feedforward neural networks

A new fast learning algorithm for feedforward neural networks using U-D factorization-based extended Kalman Filter*