Abstract:The past decade has witnessed an explosive growth of data streams in Internet, biometrics, remote sensing and other fields. Nowadays many supervised incremental/online learning approaches have been developed, to avoid retraining and reduce the computational complexity when data come chunk by chunk. However, these methods cant obtain satisfied performance when the labeled samples are limited. In this paper, we propose an Incremental Laplacian Regularization Extreme Learning Machine (ILR-ELM) for semi-supervised online learning, by utilizing both labeled and unlabeled samples. Unlike most of the existing semi-supervised incremental/online learning algorithms, this paper not only proposes incremental/online learning mechanism for data chunk containing both labeled and unlabeled samples but also proposes incremental/online learning mechanism for data chunk containing only unlabeled samples. The latter case is more common in practical applications because there is usually no enough time to label the samples for continuously arriving data stream. The alternative analytical solutions of ILR-ELM for the two incremental/online learning mechanisms are also presented. The performance of ILR-ELM is evaluated on three benchmark machine learning data, and the results show that it can achieve near accurate and robust classification/regression with a small number of labeled data, and outperforms the incremental/online learning approaches. Compared with the supervised and the comparative semi-supervised incremental/online learning methods, the generalization accuracy of ILR-ELM is increased by nearly 9% and 2% respectively for the classification problem. For the regression problem, the generalization error of ILR-ELM is reduced by nearly 14% than the supervised incremental/online learning methods and 1% than compared semi-supervised incremental/online learning methods Furthermore, ILR-ELM can achieve comparable prediction to semi-supervised batch learning, using less time and Random Access Memory (RAM). (C) 2017 Elsevier B.V. All rights reserved.

Regularized Online Sequential Extreme Learning Machine with Adaptive Regulation Factor for Time-Varying Nonlinear System.

An online sequential learning algorithm for regularized Extreme Learning Machine.

Adaptive Online Sequential Extreme Learning Machine for Dynamic Modeling

Online Regularized and Kernelized Extreme Learning Machines with Forgetting Mechanism

Online Sequential Extreme Learning Machine with Dynamic Forgetting Factor.

ROS-ELM: A Robust Online Sequential Extreme Learning Machine for Big Data Analytics

Timeliness Online Regularized Extreme Learning Machine

Data-Driven Control Based on Information Concentration Estimator and Regularized Online Sequential Extreme Learning Machine

Recurrent Kernel Online Sequential Extreme Learning Machine with Kernel Adaptive Filter for Time Series Prediction.

Kernel Online Sequential ELM Algorithm with Sliding Window Subject to Time-Varying Environments

A Novel Online Sequential Learning Algorithm for ELM Based on Optimal Control

A Robust Extreme Learning Machine Based on Adaptive Loss Function for Regression Modeling

A Constructive Enhancement for Online Sequential Extreme Learning Machine.

An effective semi-cross-validation model selection method for extreme learning machine with ridge regression.

Incremental Laplacian Regularization Extreme Learning Machine for Online Learning

The Parameter Updating Method Based on Kalman Filter for Online Sequential Extreme Learning Machine

Online Sequential ELM Algorithm with Forgetting Factor for Real Applications

Structure Adaptive Sequential Regularized Extreme Learning Machine Based on Time Series Prediction and Its Application

Efficient Leave-One-Out Cross-Validation-based Regularized Extreme Learning Machine

A robust double-parallel extreme learning machine based on an improved M-estimation algorithm

Real-Time Monitoring of Mental Fatigue of Construction Workers Using Enhanced Sequential Learning and Timeliness