Abstract:Extreme learning machine (ELM) is a fast learning algorithm for the single-hidden layer feedforward neural networks. However, usually we cannot guarantee the stability of the ELM because the parameters of the ELM are generated randomly, such as its biases of the hidden layer and the connecting weights between the input layer and the hidden layer. Besides, it is hard for a single model to achieve high predicted accuracy on the dataset with low-quality data. In this paper, we first propose a modified residual ELM (R-ELM) to improve the ELM's learning performance. In R-ELM, the first ELM is trained by the original dataset and the m-th (m > 1) ELM will be trained by the residuals between the ground truths and the predicted results of the previous ensemble model (with m - 1 ELMs). R-ELM (with m ELMs) is built in the direction of the error reduction by calculating the m-th ELM's optimal weight which is determined by the loss function of the R-ELM. As a result, R-ELM can remember almost all information of the training set. However, this ability does not assure a similar performance on the testing dataset. In view of this problem, we add L 2 regularization to the loss function of the R-ELM (RR-ELM) to avoid the overfitting problem of R-ELM. In RR-ELM, L 2 regularization is employed to encourage each ELM to ignore the unnecessary information of the training set. In order to verify the effectiveness of the two proposed algorithms, the real data from the blast furnace are engaged to perform the experiments. Experimental results illustrate that the proposed RR-ELM and the R-ELM are more stable than the single ELM. These results also demonstrate that the two proposed methods are more accurate than the average outputs of a group of ELMs, the ELM, and the support vector regression.

The adaptive ensemble of OP-ELM using forward-backward selection

Genetic Ensemble of Extreme Learning Machine

Multi-class AdaBoost ELM

RMSE-ELM: Recursive Model Based Selective Ensemble of Extreme Learning Machines for Robustness Improvement

OMP-ELM: Orthogonal Matching Pursuit-Based Extreme Learning Machine for Regression

LARSEN-ELM: Selective Ensemble of Extreme Learning Machines Using LARS for Blended Data

A Robust Extreme Learning Machine Based on Adaptive Loss Function for Regression Modeling

Larsen-elm

Robust incremental extreme learning machine

Ensemble based extreme learning machine

Evolutionary Selection Extreme Learning Machine Optimization for Regression.

Ensemble of Online Sequential Extreme Learning Machine Based on Cross-Validation

Robust Matching Pursuit Extreme Learning Machines

Optimizing Extreme Learning Machine Via Generalized Hebbian Learning and Intrinsic Plasticity Learning

Adaptive Online Sequential Extreme Learning Machine for Dynamic Modeling

Ensemble Learning via Extreme Learning Machines for Imbalanced Data

Improving Classification Performance Through an Advanced Ensemble Based Heterogeneous Extreme Learning Machines

Differential Evolution Based Selective Ensemble Of Extreme Learning Machine

A Heterogeneous AdaBoost Ensemble Based Extreme Learning Machines for Imbalanced Data

A Modified Residual Extreme Learning Machine Algorithm and Its Application

An accelerated optimization algorithm for the elastic-net extreme learning machine