Abstract:The past decade has witnessed an explosive growth of data streams in Internet, biometrics, remote sensing and other fields. Nowadays many supervised incremental/online learning approaches have been developed, to avoid retraining and reduce the computational complexity when data come chunk by chunk. However, these methods cant obtain satisfied performance when the labeled samples are limited. In this paper, we propose an Incremental Laplacian Regularization Extreme Learning Machine (ILR-ELM) for semi-supervised online learning, by utilizing both labeled and unlabeled samples. Unlike most of the existing semi-supervised incremental/online learning algorithms, this paper not only proposes incremental/online learning mechanism for data chunk containing both labeled and unlabeled samples but also proposes incremental/online learning mechanism for data chunk containing only unlabeled samples. The latter case is more common in practical applications because there is usually no enough time to label the samples for continuously arriving data stream. The alternative analytical solutions of ILR-ELM for the two incremental/online learning mechanisms are also presented. The performance of ILR-ELM is evaluated on three benchmark machine learning data, and the results show that it can achieve near accurate and robust classification/regression with a small number of labeled data, and outperforms the incremental/online learning approaches. Compared with the supervised and the comparative semi-supervised incremental/online learning methods, the generalization accuracy of ILR-ELM is increased by nearly 9% and 2% respectively for the classification problem. For the regression problem, the generalization error of ILR-ELM is reduced by nearly 14% than the supervised incremental/online learning methods and 1% than compared semi-supervised incremental/online learning methods Furthermore, ILR-ELM can achieve comparable prediction to semi-supervised batch learning, using less time and Random Access Memory (RAM). (C) 2017 Elsevier B.V. All rights reserved.

Incremental and Decremental Extreme Learning Machine Based on Generalized Inverse

A Fast Incremental Method Based on Regularized Extreme Learning Machine

An Incremental Extreme Learning Machine for Online Sequential Learning Problems

An Improved Algorithm for Incremental Extreme Learning Machine

Dense Incremental Extreme Learning Machine with Accelerating Amount and Proportional Integral Differential

Length-Changeable Incremental Extreme Learning Machine

Incremental Laplacian Regularization Extreme Learning Machine for Online Learning

Robust incremental extreme learning machine

Efficient Inverse-Free Incremental and Decremental Algorithms for Multiple Hidden Nodes in Extreme Learning Machine

Incremental regularized extreme learning machine and it's enhancement.

Improved Adaptive Incremental Error-Minimization-Based Extreme Learning Machine With Localized Generalization Error Model

Extreme Learning Machine With Adaptive Growth Of Hidden Nodes And Incremental Updating Of Output Weights

Improvement Algorithm of an Incremental Extreme Learning Machine

An Improved Extreme Learning Machine with Self-Recurrent Hidden Layer

Dynamic Adjustment of Hidden Layer Structure for Convex Incremental Extreme Learning Machine

An online sequential learning algorithm for regularized Extreme Learning Machine.

Inverse-Free Extreme Learning Machine with Optimal Information Updating

Adaptive Online Sequential Extreme Learning Machine for Dynamic Modeling

Improved Convex Incremental Extreme Learning Machine Based on Enhanced Random Search

A-ELM: Adaptive Distributed Extreme Learning Machine with MapReduce.

Back-propagation Extreme Learning Machine