Abstract:Machine Learning algorithms have been widely used to solve various kinds of data classification problems. Classification problem especially for high dimensional datasets have attracted many researchers in order to find efficient approaches to address them. However, the classification problem has become very complicated and computationally expensive, especially when the number of possible different combinations of variables is so high. Support Vector Machine (SVM) has been proven to perform much better when dealing with high dimensional datasets and numerical features. Although SVM works well with default value, the performance of SVM can be improved significantly using parameter optimization. We applied two methods which are Grid Search and Genetic Algorithm (GA) to optimize the SVM parameters. Our experiment showed that SVM parameter optimization using grid search always finds near optimal parameter combination within the given ranges. However, grid search was very slow; therefore it was very reliable only in low dimensional datasets with few parameters. SVM parameter optimization using GA can be used to solve the problem of grid search. GA has proven to be more stable than grid search. Based on average running time on 9 datasets, GA was almost 16 times faster than grid search. Futhermore, the GA’s results were slighlty better than the grid search in 8 of 9 datasets.

Tuning SVM Parameters by Using a Hybrid CLPSO-BFGS Algorithm

SVM KERNEL PARAMETER SELECTION BASED ON IMPROVED GSO

Swarm Intelligent Tuning Of One-Class V-Svm Parameters

Feature Selection and Parameter Optimization for Support Vector Machines: A New Approach Based on Genetic Algorithm with Feature Chromosomes.

Novel Linear Search for Support Vector Machine Parameter Selection

SVM Parameter Optimization using Grid Search and Genetic Algorithm to Improve Classification Performance

Determination of Optimal SVM Parameters by Using GA/PSO

Hybrid-QPSO-based Parameters Optimization of LS-SVM and Its Application

A Novel LS-SVMs Hyper-Parameter Selection Based on Particle Swarm Optimization

Parameter Optimization of SVM Based on Particle Swarm Optimization Algorithm and GPU Acceleration

Hybrid optimization method for parameter selection of support vector machine

A parameter optimization method for an SVM based on improved grid search algorithm

Multiple Parameter Selection for Ls-Svm Using Smooth Leave-One-Out Error

Towards an Optimal Support Vector Machine Classifier Using a Parallel Particle Swarm Optimization Strategy.

Parameter Selection of Support Vector Regression Based on Hybrid Optimization Algorithm and Its Application

Parameter Selection Method for Svm with Pso

PSO-Based hyper-parameters selection for LS-SVM classifiers

Hyper-parameter tuning for support vector machine using an improved cat swarm optimization algorithm

Optimization of Support Vector Regression Parameters by Flower Pollination Algorithm

An Improved Parameter Tuning Method For Support Vector Machines

Particle Swarm Optimization for Parameter Optimization of Support Vector Machine Model