Abstract:Support Vector Machines (SVMs) have become a popular tool for learning with large amounts of high dimensional data. But it may sometimes be preferable to learn incrementally from previous SVM results, as SVMs which involve the solution of a quadratic programming problem suffer from the problem of large memory requirement and CPU time when trained in batch mode on large data sets. And the SVMs may be used in online learning setting. In this paper an approach for incremental learning with Support Vector Machines is presented. We define the normal solution of the incremental learning for SVMs which is defined as the solution minimizing a given positive-definite quadratic form in the coordinates of the difference vector between the normal vectors at the (k-1)-th and k-th incremental step and discuss the relation to standard SVM. It was shown that concept learned at last step will not change if new data satisfy separable condition and empirical evidence is given to prove that this approach can effectively deal with changes in the target concept that are results of the incremental learning setting according to three evaluation criteria: stability, improvement and recoverability.

A New Cache Replacement Algorithm In Smo

A Parallel and Scalable Digital Architecture for Training Support Vector Machines

A new strategy for selecting working sets applied in SMO

A Fast Training Method for OC-SVM Based on the Random Sampling Lemma

A Sampling-based SMO Algorithm

Single Sequential Minimal Optimization: an Improved SVMs Training Algorithm

Fast training of support vector machines using sequential minimal optimization, advances in kernel methods

An Incremental Updating Method for Support Vector Machines

A New Working Set Selection For Smo-Type Decomposition Methods

Recursive Training Algorithm for One-Class Support Vector Machine Based on Active Set Method

Fast Training of Support Vector Machines using Sequential Minimal Optimization

Hierarchical 1-FSVM Algorithm Based on SMO

Fast Training Support Vector Machines Using Parallel Sequential Minimal Optimization

Sequential minimal optimization for SVM with pinball loss.

Improved Conjugate Gradient Implementation for Least Squares Support Vector Machines

An Improved SMO Algorithm Based on Trade-off Strategy

A Novel Model of Working Set Selection for SMO Decomposition Methods

On-line Support Vector Machine Training Algorithm and Its Application

A Cache Replacement Algorithm in Hierarchical Storage of Continuous Media Object

Mini-batch Quasi-Newton Optimization for Large Scale Linear Support Vector Regression

Fast Incremental Learning Method for One-Class Support Vector Machine