Abstract:The past decade has witnessed an explosive growth of data streams in Internet, biometrics, remote sensing and other fields. Nowadays many supervised incremental/online learning approaches have been developed, to avoid retraining and reduce the computational complexity when data come chunk by chunk. However, these methods cant obtain satisfied performance when the labeled samples are limited. In this paper, we propose an Incremental Laplacian Regularization Extreme Learning Machine (ILR-ELM) for semi-supervised online learning, by utilizing both labeled and unlabeled samples. Unlike most of the existing semi-supervised incremental/online learning algorithms, this paper not only proposes incremental/online learning mechanism for data chunk containing both labeled and unlabeled samples but also proposes incremental/online learning mechanism for data chunk containing only unlabeled samples. The latter case is more common in practical applications because there is usually no enough time to label the samples for continuously arriving data stream. The alternative analytical solutions of ILR-ELM for the two incremental/online learning mechanisms are also presented. The performance of ILR-ELM is evaluated on three benchmark machine learning data, and the results show that it can achieve near accurate and robust classification/regression with a small number of labeled data, and outperforms the incremental/online learning approaches. Compared with the supervised and the comparative semi-supervised incremental/online learning methods, the generalization accuracy of ILR-ELM is increased by nearly 9% and 2% respectively for the classification problem. For the regression problem, the generalization error of ILR-ELM is reduced by nearly 14% than the supervised incremental/online learning methods and 1% than compared semi-supervised incremental/online learning methods Furthermore, ILR-ELM can achieve comparable prediction to semi-supervised batch learning, using less time and Random Access Memory (RAM). (C) 2017 Elsevier B.V. All rights reserved.

Timeliness Online Regularized Extreme Learning Machine

A Fast Incremental Method Based on Regularized Extreme Learning Machine

Extreme Learning Machine Combining Hidden-Layer Feature Weighting and Batch Training for Classification

Incremental Laplacian Regularization Extreme Learning Machine for Online Learning

Regularized Online Sequential Extreme Learning Machine with Adaptive Regulation Factor for Time-Varying Nonlinear System.

Online Regularized and Kernelized Extreme Learning Machines with Forgetting Mechanism

Online sequential extreme learning machine with forgetting mechanism.

An Incremental Extreme Learning Machine for Online Sequential Learning Problems

Incremental regularized extreme learning machine and it's enhancement.

An Improved Extreme Learning Machine with Self-Recurrent Hidden Layer

ELM-KL-LSTM: a robust and general incremental learning method for efficient classification of time series data

Prediction Based on Online Extreme Learning Machine in WWTP Application

Online sequential extreme learning machine with the increased classes

Optimizing Extreme Learning Machine Via Generalized Hebbian Learning and Intrinsic Plasticity Learning

A Novel Online Sequential Learning Algorithm for ELM Based on Optimal Control

Ordinal Extreme Learning Machine

The Memory Degradation Based Online Sequential Extreme Learning Machine

A New Online Learning Algorithm for Structure-Adjustable Extreme Learning Machine

Pr-elm

Extreme learning machine: algorithm, theory and applications

Structure Adaptive Sequential Regularized Extreme Learning Machine Based on Time Series Prediction and Its Application