Abstract:Support Vector Machines (SVMs) deliver state-of-the-art performance in real-world applications and are now established as one of the standard tools for machine learning and data mining. A key problem of these methods is how to choose an optimal kernel and how to optimise its parameters. The real-world applications have also emphasised the need to consider a combination of kernels—a multiple kernel—in order to boost the classification accuracy by adapting the kernel to the characteristics of heterogeneous data. This combination could be linear or non-linear, weighted or un-weighted. Several approaches have been already proposed to find a linear weighted kernel combination and to optimise its parameters together with the SVM parameters, but no approach has tried to optimise a non-linear weighted combination. Therefore, our goal is to automatically generate and adapt a kernel combination (linear or non-linear, weighted or un-weighted, according to the data) and to optimise both the kernel parameters and SVM parameters by evolutionary means in a unified framework. We will denote our combination as a kernel of kernels (KoK). Numerical experiments show that the SVM algorithm, involving the evolutionary kernel of kernels (eKoK) we propose, performs better than well-known classic kernels whose parameters were optimised and a state of the art convex linear and an evolutionary linear, respectively, kernel combinations. These results emphasise the fact that the SVM algorithm could require a non-linear weighted combination of kernels.

Evolving Support Vector Machine Parameters

Feature Selection and Parameter Optimization for Support Vector Machines: A New Approach Based on Genetic Algorithm with Feature Chromosomes.

Novel Linear Search for Support Vector Machine Parameter Selection

SVM KERNEL PARAMETER SELECTION BASED ON IMPROVED GSO

Support Vector Machines Ensemble With Optimizing Weights By Genetic Algorithm

An Incremental Updating Method for Support Vector Machines

Swarm Intelligent Tuning Of One-Class V-Svm Parameters

Evolutionary support center machine

A new improved support vector machine: QGA-SVM

M-estimator Based Support Vector Machine and Its Application

An MPEC Model for Selecting Optimal Parameter in Support Vector Machines

Editing Support Vector Machines

Improving classification performance of Support Vector Machine by genetically optimising kernel shape and hyper-parameters

Hyper-parameter tuning for support vector machine using an improved cat swarm optimization algorithm

Parameters optimization of support vector machines for imbalanced data using social ski driver algorithm

Enhancing Support Vector Machine Performance: A Hybrid Approach with Davidon-Fletcher-Powell Algorithm and Elephant Herding Optimization (EHO-DFP) for Parameter Optimization

Parameter Optimization of Support Vector Machine Using Dragonfly Algorithm

SVR Kernel Parameters Selection Based on Steady-State Genetic Algorithm

Parameter choosing method of support vector regression for time series prediction

Mini-batch Quasi-Newton Optimization for Large Scale Linear Support Vector Regression

Scaling the kernel function to improve performance of the support vector machine