Abstract:The selection of Gaussian kernel parameters plays an important role in the applications of support vector classification (SVC). A commonly used method is the k-fold cross validation with grid search (CV), which is extremely time-consuming because it needs to train a large number of SVC models. In this paper, a new approach is proposed to train SVC and optimize the selection of Gaussian kernel parameters. We first formulate the training and parameter selection of SVC as a minimax optimization problem named as MaxMin-L2-SVC-NCH, in which the minimization problem is an optimization problem of finding the closest points between two normal convex hulls (L2-SVC-NCH) while the maximization problem is an optimization problem of finding the optimal Gaussian kernel parameters. A lower time complexity can be expected in MaxMin-L2-SVC-NCH because CV is not needed. We then propose a projected gradient algorithm (PGA) for training L2-SVC-NCH. The famous sequential minimal optimization (SMO) algorithm is a special case of the PGA. Thus, the PGA can provide more flexibility than the SMO. Furthermore, the solution of the maximization problem is done by a gradient ascent algorithm with dynamic learning rate. The comparative experiments between MaxMin-L2-SVC-NCH and the previous best approaches on public datasets show that MaxMin-L2-SVC-NCH greatly reduces the number of models to be trained while maintaining competitive test accuracy. These findings indicate that MaxMin-L2-SVC-NCH is a better choice for SVC tasks.

Parameter Optimization of LS-SVM for Regression Using NGA

SVM KERNEL PARAMETER SELECTION BASED ON IMPROVED GSO

Feature Selection and Parameter Optimization for Support Vector Machines: A New Approach Based on Genetic Algorithm with Feature Chromosomes.

Novel Linear Search for Support Vector Machine Parameter Selection

The Optimization for Parameter of Kernel Function with GA

Hybrid optimization algorithm for load model parameter identification

A new improved support vector machine: QGA-SVM

Swarm Intelligent Tuning Of One-Class V-Svm Parameters

Multi-objective parameters selection for SVM classification using NSGA-II

Parameter Optimization For Svm Using Sequential Number Theoretic For Optimization

SVM Parameter Optimization using Grid Search and Genetic Algorithm to Improve Classification Performance

Mini-batch Quasi-Newton Optimization for Large Scale Linear Support Vector Regression

Hyper Parameters Selection For Svr Based On Steady-State Genetic Algorithm

Parameters Selection in Gene Selection Using Gaussian Kernel Support Vector Machines by Genetic Algorithm

Local Parameter Optimization of LSSVM for Industrial Soft Sensing with Big Data and Cloud Implementation

MaxMin-L2-SVC-NCH: A Novel Approach for Support Vector Classifier Training and Parameter Selection

Least Square Generalized Support Vector Machines for Regression

Parameters optimization of support vector machines for imbalanced data using social ski driver algorithm

Parameter choosing method of support vector regression for time series prediction

Hybrid optimization of feature selection and SVM training model

Slope Stability Forecast of LS-SVM Based on Chaos Genetic Algorithm Optimization