Abstract:Support Vector Machines (SVMs) have become a popular tool for learning with large amounts of high dimensional data. But it may sometimes be preferable to learn incrementally from previous SVM results, as SVMs which involve the solution of a quadratic programming problem suffer from the problem of large memory requirement and CPU time when trained in batch mode on large data sets. And the SVMs may be used in online learning setting. In this paper an approach for incremental learning with Support Vector Machines is presented. We define the normal solution of the incremental learning for SVMs which is defined as the solution minimizing a given positive-definite quadratic form in the coordinates of the difference vector between the normal vectors at the (k-1)-th and k-th incremental step and discuss the relation to standard SVM. It was shown that concept learned at last step will not change if new data satisfy separable condition and empirical evidence is given to prove that this approach can effectively deal with changes in the target concept that are results of the incremental learning setting according to three evaluation criteria: stability, improvement and recoverability.

Adaptive Iterative LS-SVM Regression Algorithm Based on Vector Base Learning

New Predictive Control Algorithms Based on Least Squares Support Vector Machines

Recursive Least Squares Support Vector Regression

Sparse Representation Based on Projection Method in Online Least Squares Support Vector Machines

Modeling of Isomerization of C-8 Aromatics by Online Least Squares Support Vector Machine

Robust Iterative Algorithm of Weighted Least Squares Support Vector Machine and Its Application in Spectral Analysis

Using Svm To Model And Control Nonlinear Dynamical Systems

Modeling method of least squares support vector regression based on vector base learning

M-estimator Based Support Vector Machine and Its Application

Iterative robust least square support vector machine for spectral analysis

Dynamic least squares support vector machine

An Incremental Updating Method for Support Vector Machines

Sparse Least Squares Support Vector Machine for Function Estimation

Modeling and Prediction Based on Recursive Least Square Support Vector Regression

Mini-batch Quasi-Newton Optimization for Large Scale Linear Support Vector Regression

Dynamic Weighted Least Squares Support Vector Machines

Online SVM regression algorithm-based adaptive inverse control

Fast Online SVR Algorithm Based Adaptive Internal Model Control

INCREMENTAL LEARNING WITH SUPPORT VECTOR REGRESSION FOR PITCH-CONTROLLED WIND TURBINE ONLINE IDENTIFICATION

Support vector machine adaptive control of nonlinear systems

Local least squares support vector regression with application to online modeling for batch processes