Abstract:This chapter describes a new algorithm for training Support Vector Machines: Sequential Minimal Optimization, or SMO. Training a Support Vector Machine (SVM) requires the solution of a very large quadratic programming (QP) optimization problem. SMO breaks this large QP problem into a series of smallest possible QP problems. These small QP problems are solved analytically, which avoids using a time-consuming numerical QP optimization as an inner loop. The amount of memory required for SMO is linear in the training set size, which allows SMO to handle very large training sets. Because large matrix computation is avoided, SMO scales somewhere between linear and quadratic in the training set size for various test problems, while a standard projected conjugate gradient (PCG) chunking algorithm scales somewhere between linear and cubic in the training set size. SMO's computation time is dominated by SVM evaluation, hence SMO is fastest for linear SVMs and sparse data sets. For the MNIST database, SMO is as fast as PCG chunking; while for the UCI Adult database and linear SVMs, SMO can be more than 1000 times faster than the PCG chunking algorithm.

An Improved Sequential Minimal Optimization Algorithm

A Parallel and Scalable Digital Architecture for Training Support Vector Machines

Single Sequential Minimal Optimization: an Improved SVMs Training Algorithm

A Sampling-based SMO Algorithm

Improvements on Sequential Minimal Optimization Algorithm for Support Vector Machine Based on Semi-sparse Algorithm

An Improvement of Sequential Minimum Optimization Algorithm

A Fast Training Method for OC-SVM Based on the Random Sampling Lemma

A Novel Online Least Squares Svm Based on Smo Algorithm

Fast training of support vector machines using sequential minimal optimization, advances in kernel methods

An Improved SMO Algorithm Based on Trade-off Strategy

A new strategy for selecting working sets applied in SMO

Fast Training of Support Vector Machines using Sequential Minimal Optimization

Fast Training Support Vector Machines Using Parallel Sequential Minimal Optimization

An Improved APSO-SQP with Adaptive Transition Strategy for Dynamic Optimization

A New Weighted Least Squares Support Vector Machines and Its Sequential Minimal Optimization Algorithm

A Novel Model of Working Set Selection for SMO Decomposition Methods

A New Cache Replacement Algorithm In Smo

A New Working Set Selection For Smo-Type Decomposition Methods

Sequential minimal optimization for SVM with pinball loss.

Hierarchical 1-FSVM Algorithm Based on SMO

An Improved Way to Make Large-Scale SVR Learning Practical