Abstract:The parameters of support vector machines (SVMs) such as the penalty parameter and the kernel parameters have a great impact on the classification accuracy and the complexity of the SVM model. Therefore, the model selection in SVM involves the tuning of these parameters. However, these parameters are usually tuned and used as a black box, without understanding the mathematical background or internal details. In this paper, the behavior of the SVM classification model is analyzed when these parameters take different values with balanced and imbalanced data. This analysis including visualization, mathematical and geometrical interpretations and illustrative numerical examples with the aim of providing the basics of the Gaussian and linear kernel functions with SVM. From this analysis, we proposed a novel search algorithm. In this algorithm, we search for the optimal SVM parameters into two one-dimensional spaces instead of searching into one two-dimensional space. This reduces the computational time significantly. Moreover, in our algorithm, from the analysis of the data, the range of kernel function can be expected. This also reduces the search space and hence reduces the required computational time. Different experiments were conducted to evaluate our search algorithm using different balanced and imbalanced datasets. The results demonstrated how the proposed strategy is fast and effective than other searching strategies.

Performance Analysis of Support Vector Machines with Gauss Kernel

SVM KERNEL PARAMETER SELECTION BASED ON IMPROVED GSO

Determination of the Spread Parameter in the Gaussian Kernel for Classification and Regression

Parameter Selection of SVM with Gaussian kernel

Efficient Model Selection for Support Vector Machine with Gaussian Kernel Function

Support Vector Machine with Gauss Kernel Classified Method and Model Selection

Least Squares Support Vector Machine Based on Scaling Kernel Function

A Large Dimensional Analysis of Least Squares Support Vector Machines

An Analytical Approach to Fast Parameter Selection of Gaussian Rbf Kernel for Support Vector Machine

Behavioral analysis of support vector machine classifier with Gaussian kernel and imbalanced data

An Adaptive Gaussian Kernel for Support Vector Machine

Experimental Study on the Performance of Support Vector Machine with Squared Cost Function

Scaling the kernel function to improve performance of the support vector machine

Least squares support vector machine on gaussian wavelet kernel function set

Random matrices meet machine learning: a large dimensional analysis of LS-SVM

Support Vector Classification and Gaussian Kernel with Multiple Widths

Fast and Efficient Strategies for Model Selection of Gaussian Support Vector Machine

Optimal Gaussian Kernel Parameter Selection for SVM Classifier

An information-geometrical method for improving the performance of support vector machine classifiers

A New Method for Determining the Parameter of Gaussian Kernel

A New Compound Kernel Function for SVM.