Abstract:In many applications of kernel method, such as support vector machine (SVM), the performance greatly depends on the choice of kernel. It is not always clear what is the most suitable kernel for one specified task. Multiple kernel learning (MKL) allows to optimize over linear combinations of kernels. A two-step approach, which alternately optimizes the standard SVM and kernel weights, is proposed to solve the non-convex MKL problem. The generalized convexity of MKL is studied which guarantees the strong duality of the corresponding optimization problem. A further contribution is the utilization of a computationally efficient inexact-projection-based method to optimize the standard SVM. In addition, a nonmonotone gradient method is proposed to optimize the kernel weights and the Hessian matrix is approximated with a variation of Limited-memory Broyden-Fletcher-Goldfarb-Shanno (L-BFGS) approach. The global convergence of the proposed two-step approach is analyzed. The utility of the proposed scheme is demonstrated by empirical study with several datasets, and its performance is compared with state-of-the-art methods in terms of accuracy and scalability. The results show that the proposed method performs as well as existing methods in accuracy, but takes much less time to converge to the stationary point.

Support Vector Classification and Gaussian Kernel with Multiple Widths

Feature Selection and Parameter Optimization for Support Vector Machines: A New Approach Based on Genetic Algorithm with Feature Chromosomes.

Generalized Convexity-Based Inexact Projection Method for Multiple Kernel Learning

Efficient Model Selection for Support Vector Machine with Gaussian Kernel Function

A new improved support vector machine: QGA-SVM

Improved support vector machine for multi-class classification problems

Multi-Resolution Kernel Support Vector Classifier Based on Parameters Automatic Selection

Multiclass Kernel Polarization and Its Application to Parameter Selection of RBF Kernel with Multiple Widths

Optimal Gaussian Kernel Parameter Selection for SVM Classifier

Support Vector Machine with Gauss Kernel Classified Method and Model Selection

Large-margin multi-view Gaussian process for image classification

Multi-scale Cauchy Kernel Function and Its Application in Multi-class SVM

Two Methods of Selecting Gaussian Kernel Parameters for One-Class Svm and Their Application to Fault Detection

Fast and Efficient Strategies for Model Selection of Gaussian Support Vector Machine

Parameters Selection in Gene Selection Using Gaussian Kernel Support Vector Machines by Genetic Algorithm

Parameter selection of Gaussian kernel for one-class SVM.

Parameter Selection of SVM with Gaussian kernel

Modifications of Kernels to Improve Support Vector Machine Classifiers

Gene Selection Using Gaussian Kernel Support Vector Machine Based Recursive Feature Elimination with Adaptive Kernel Width Strategy

Large-margin multi-view Gaussian process

Learning Distance Metric for Support Vector Machine: A Multiple Kernel Learning Approach.