Abstract:Two strategies for selecting the kernel parameter (sigma) and the penalty coefficient (C) of Gaussian support vector machines (SVMs) are suggested in this paper. Based on viewing the model parameter selection problem as a recognition problem in visual systems, a direct parameter setting formula for the kernel parameter is derived through finding a visual scale at which the global and local structures of the given data set can be preserved in the feature space, and the difference between the two structures can be maximized. In addition, we propose a heuristic algorithm for the selection of the penalty coefficient through identifying the classification extent of a training datum in the implementation process of the sequential minimal optimization (SMO) procedure, which is a well-developed and commonly used algorithm in SVM training. We then evaluate the suggested strategies with a series of experiments on 13 benchmark problems and three real-world data sets, as compared with the traditional 5-cross validation (5-CV) method and the recently developed radius-margin bound (RM) method. The evaluation shows that in terms of efficiency and generalization capabilities, the new strategies outperform the current methods, and the performance is uniform and stable.

A new strategy for selecting working sets applied in SMO

A New Working Set Selection For Smo-Type Decomposition Methods

A Parallel and Scalable Digital Architecture for Training Support Vector Machines

A Sampling-based SMO Algorithm

A Fast Training Method for OC-SVM Based on the Random Sampling Lemma

A Novel Model of Working Set Selection for SMO Decomposition Methods

An Improvement of Sequential Minimum Optimization Algorithm

A New Cache Replacement Algorithm In Smo

Fast training of support vector machines using sequential minimal optimization, advances in kernel methods

Single Sequential Minimal Optimization: an Improved SVMs Training Algorithm

A Novel Online Least Squares Svm Based on Smo Algorithm

Fast Training of Support Vector Machines using Sequential Minimal Optimization

Fast Training Support Vector Machines Using Parallel Sequential Minimal Optimization

Improvements on Sequential Minimal Optimization Algorithm for Support Vector Machine Based on Semi-sparse Algorithm

An Improved SMO Algorithm Based on Trade-off Strategy

A New Support Vector Machine Algorithm with Scalable Penalty Coefficients for Training Samples

Hierarchical 1-FSVM Algorithm Based on SMO

A New Weighted Least Squares Support Vector Machines and Its Sequential Minimal Optimization Algorithm

An Improved SMO Algorithm Based on Dynamic Filtration Strategy

Sequential minimal optimization for SVM with pinball loss.

Fast and Efficient Strategies for Model Selection of Gaussian Support Vector Machine