Abstract:The selection of Gaussian kernel parameters plays an important role in the applications of support vector classification (SVC). A commonly used method is the k-fold cross validation with grid search (CV), which is extremely time-consuming because it needs to train a large number of SVC models. In this paper, a new approach is proposed to train SVC and optimize the selection of Gaussian kernel parameters. We first formulate the training and parameter selection of SVC as a minimax optimization problem named as MaxMin-L2-SVC-NCH, in which the minimization problem is an optimization problem of finding the closest points between two normal convex hulls (L2-SVC-NCH) while the maximization problem is an optimization problem of finding the optimal Gaussian kernel parameters. A lower time complexity can be expected in MaxMin-L2-SVC-NCH because CV is not needed. We then propose a projected gradient algorithm (PGA) for training L2-SVC-NCH. The famous sequential minimal optimization (SMO) algorithm is a special case of the PGA. Thus, the PGA can provide more flexibility than the SMO. Furthermore, the solution of the maximization problem is done by a gradient ascent algorithm with dynamic learning rate. The comparative experiments between MaxMin-L2-SVC-NCH and the previous best approaches on public datasets show that MaxMin-L2-SVC-NCH greatly reduces the number of models to be trained while maintaining competitive test accuracy. These findings indicate that MaxMin-L2-SVC-NCH is a better choice for SVC tasks.

An MPEC Model for Selecting Optimal Parameter in Support Vector Machines

Novel Linear Search for Support Vector Machine Parameter Selection

Feature Selection and Parameter Optimization for Support Vector Machines: A New Approach Based on Genetic Algorithm with Feature Chromosomes.

M-estimator Based Support Vector Machine and Its Application

Melt Index Prediction by Weighted Least Squares Support Vector Machines

An Mpec Estimator for Misclassification Models

Cost Sensitive Support Vector Machines

Evolving Support Vector Machine Parameters

Smoothing Partial Exact Penalty Splitting Method for Mathematical Programs with Equilibrium Constraints

SVM-Based Cost-sensitive Classification Algorithm with Error Cost and Class-dependent Reject Cost

Entire Solution Path for Support Vector Machine for Positive and Unlabeled Classification

Evolutionary support center machine

On support vector machines under a multiple-cost scenario

Optimisation of Cutting Parameters for Improving Energy Efficiency in Machining Process

An Effective Model Selection Criterion for Mixtures of Gaussian Processes.

MPMSVC: Multiple Parametric-Margin Support Vector Clustering

A New Parameter Selection Method for Support Vector Machine Based on the Decision Value.

MaxMin-L2-SVC-NCH: A Novel Approach for Support Vector Classifier Training and Parameter Selection

Machine Learning based parameter tuning strategy for MMC based topology optimization

Smoothing parameter selection method for multiresponse nonparametric regression model using smoothing spline and Kernel estimators approaches

Support vector machines within a bivariate mixed-integer linear programming framework