Abstract:Support Vector Machines (SVMs) deliver state-of-the-art performance in real-world applications and are now established as one of the standard tools for machine learning and data mining. A key problem of these methods is how to choose an optimal kernel and how to optimise its parameters. The real-world applications have also emphasised the need to consider a combination of kernels—a multiple kernel—in order to boost the classification accuracy by adapting the kernel to the characteristics of heterogeneous data. This combination could be linear or non-linear, weighted or un-weighted. Several approaches have been already proposed to find a linear weighted kernel combination and to optimise its parameters together with the SVM parameters, but no approach has tried to optimise a non-linear weighted combination. Therefore, our goal is to automatically generate and adapt a kernel combination (linear or non-linear, weighted or un-weighted, according to the data) and to optimise both the kernel parameters and SVM parameters by evolutionary means in a unified framework. We will denote our combination as a kernel of kernels (KoK). Numerical experiments show that the SVM algorithm, involving the evolutionary kernel of kernels (eKoK) we propose, performs better than well-known classic kernels whose parameters were optimised and a state of the art convex linear and an evolutionary linear, respectively, kernel combinations. These results emphasise the fact that the SVM algorithm could require a non-linear weighted combination of kernels.

An Adaptive Gaussian Kernel for Support Vector Machine

SVM KERNEL PARAMETER SELECTION BASED ON IMPROVED GSO

A new trigonometric kernel function for support vector machine

Gauss-like Logarithmic Kernel Function to improve the performance of kernel machines on the small datasets

Support vector machine adaptive control of nonlinear systems

A Learning Algorithm with Gaussian Regularizer for Kernel Neuron

Behavioral analysis of support vector machine classifier with Gaussian kernel and imbalanced data

Machine Learning Application of Generalized Gaussian Radial Basis Function and Its Reproducing Kernel Theory

A support vector data description algorithm based on an adaptive kernel function

An information-geometrical method for improving the performance of support vector machine classifiers

Gene Selection Using Gaussian Kernel Support Vector Machine Based Recursive Feature Elimination with Adaptive Kernel Width Strategy

Improving Support Vector Machine Classifiers By Modifying Kernel Functions

Gaussian Kernel Variance For an Adaptive Learning Method on Signals Over Graphs

A Robust Optimization Model for Nonlinear Support Vector Machine

Support Feature Machines

Study of Set-Membership Adaptive Kernel Algorithms

A Large Dimensional Analysis of Least Squares Support Vector Machines

Scaling the kernel function to improve performance of the support vector machine

Improving classification performance of Support Vector Machine by genetically optimising kernel shape and hyper-parameters

A support vector machine classifier based on a new kernel function model for hyperspectral data

Self-supervised Adaptive Kernel Nonnegative Matrix Factorization.