Abstract:Extreme learning machine (ELM) is a fast learning algorithm for the single-hidden layer feedforward neural networks. However, usually we cannot guarantee the stability of the ELM because the parameters of the ELM are generated randomly, such as its biases of the hidden layer and the connecting weights between the input layer and the hidden layer. Besides, it is hard for a single model to achieve high predicted accuracy on the dataset with low-quality data. In this paper, we first propose a modified residual ELM (R-ELM) to improve the ELM's learning performance. In R-ELM, the first ELM is trained by the original dataset and the m-th (m > 1) ELM will be trained by the residuals between the ground truths and the predicted results of the previous ensemble model (with m - 1 ELMs). R-ELM (with m ELMs) is built in the direction of the error reduction by calculating the m-th ELM's optimal weight which is determined by the loss function of the R-ELM. As a result, R-ELM can remember almost all information of the training set. However, this ability does not assure a similar performance on the testing dataset. In view of this problem, we add L 2 regularization to the loss function of the R-ELM (RR-ELM) to avoid the overfitting problem of R-ELM. In RR-ELM, L 2 regularization is employed to encourage each ELM to ignore the unnecessary information of the training set. In order to verify the effectiveness of the two proposed algorithms, the real data from the blast furnace are engaged to perform the experiments. Experimental results illustrate that the proposed RR-ELM and the R-ELM are more stable than the single ELM. These results also demonstrate that the two proposed methods are more accurate than the average outputs of a group of ELMs, the ELM, and the support vector regression.

A Pruning Ensemble Model of Extreme Learning Machine with $$L_{1/2}$$L1/2 Regularizer

A Pruning Ensemble Model of Extreme Learning Machine with <Emphasis Type="Italic">L</Emphasis><Subscript>1/2</Subscript> Regularizer

Genetic Ensemble of Extreme Learning Machine

A Fast Incremental Method Based on Regularized Extreme Learning Machine

A pruning algorithm with L 1/2 regularizer for extreme learning machine

A New Pruning Algorithm for Extreme Learning Machine

Regression and Classification Using Extreme Learning Machine Based on L-1-Norm and L-2-Norm

Hierarchical Pruning Discriminative Extreme Learning Machine

Hierarchical Ensemble of Extreme Learning Machine.

A Generalized Pruning Algorithm for Extreme Learning Machine.

A Pruning Algorithm for Extreme Learning Machine Based on Sparse Coding.

Optimizing Extreme Learning Machine Via Generalized Hebbian Learning and Intrinsic Plasticity Learning

Design of Extreme Learning Machine with Smoothed ℓ 0 Regularization

PR-ELM: Parallel regularized extreme learning machine based on cluster.

Pr-elm

Ensemble based extreme learning machine

L1-Norm Robust Regularized Extreme Learning Machine with Asymmetric C-Loss for Regression.

A Modified Residual Extreme Learning Machine Algorithm and Its Application

Two-stage Extreme Learning Machine for Regression.

Parsimonious Extreme Learning Machine Using Recursive Orthogonal Least Squares.

Incremental regularized extreme learning machine and it's enhancement.