Abstract:Two strategies for selecting the kernel parameter (sigma) and the penalty coefficient (C) of Gaussian support vector machines (SVMs) are suggested in this paper. Based on viewing the model parameter selection problem as a recognition problem in visual systems, a direct parameter setting formula for the kernel parameter is derived through finding a visual scale at which the global and local structures of the given data set can be preserved in the feature space, and the difference between the two structures can be maximized. In addition, we propose a heuristic algorithm for the selection of the penalty coefficient through identifying the classification extent of a training datum in the implementation process of the sequential minimal optimization (SMO) procedure, which is a well-developed and commonly used algorithm in SVM training. We then evaluate the suggested strategies with a series of experiments on 13 benchmark problems and three real-world data sets, as compared with the traditional 5-cross validation (5-CV) method and the recently developed radius-margin bound (RM) method. The evaluation shows that in terms of efficiency and generalization capabilities, the new strategies outperform the current methods, and the performance is uniform and stable.

A Gaussian radial basis function based feature selection algorithm

Novel Linear Search for Support Vector Machine Parameter Selection

Feature Selection and Parameter Optimization for Support Vector Machines: A New Approach Based on Genetic Algorithm with Feature Chromosomes.

SVM KERNEL PARAMETER SELECTION BASED ON IMPROVED GSO

Parameter Selection For Gaussian Radial Basis Function In Support Vector Machine Classification

An Analytical Approach to Fast Parameter Selection of Gaussian Rbf Kernel for Support Vector Machine

Parameters Selection in Gene Selection Using Gaussian Kernel Support Vector Machines by Genetic Algorithm

Efficient Model Selection for Support Vector Machine with Gaussian Kernel Function

Parameter Selection of SVM with Gaussian kernel

Kernel Parameter Selection for Support Vector Machine Classification

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

Super-parameter Selection for Gaussian-Kernel SVM Based on Outlier-Resisting

Fast and Efficient Strategies for Model Selection of Gaussian Support Vector Machine

Gene Selection Using Gaussian Kernel Support Vector Machine Based Recursive Feature Elimination with Adaptive Kernel Width Strategy

A Novel Wrapper Method for Feature Selection and Its Applications

Optimal Gaussian Kernel Parameter Selection for SVM Classifier

Robust Gaussian Kernel Based Approach for Feature Selection

SVM Parameter Selection Algorithm Based on Maximum Kernel Similarity Diversity

A New Method for Determining the Parameter of Gaussian Kernel

Parameter selection of Gaussian kernel for one-class SVM.

A SVM-based Feature Selection Method and Its Applications