Abstract:Kernel methods have been successfully applied in various applications. To succeed in these applications, it is crucial to learn a good kernel representation, whose objective is to reveal the data similarity precisely. In this paper, we address the problem of multiple kernel learning (MKL), searching for the optimal kernel combination weights through maximizing a generalized performance measure. Most MKL methods employ the L(1)-norm simplex constraints on the kernel combination weights, which therefore involve a sparse but non-smooth solution for the kernel weights. Despite the success of their efficiency, they tend to discard informative complementary or orthogonal base kernels and yield degenerated generalization performance. Alternatively, imposing the L(p)-norm (p > 1) constraint on the kernel weights will keep all the information in the base kernels. This leads to non-sparse solutions and brings the risk of being sensitive to noise and incorporating redundant information. To tackle these problems, we propose a generalized MKL (GMKL) model by introducing an elastic-net-type constraint on the kernel weights. More specifically, it is an MKL model with a constraint on a linear combination of the L(1)-norm and the squared L(2)-norm on the kernel weights to seek the optimal kernel combination weights. Therefore, previous MKL problems based on the L(1)-norm or the L(2)-norm constraints can be regarded as special cases. Furthermore, our GMKL enjoys the favorable sparsity property on the solution and also facilitates the grouping effect. Moreover, the optimization of our GMKL is a convex optimization problem, where a local solution is the global optimal solution. We further derive a level method to efficiently solve the optimization problem. A series of experiments on both synthetic and real-world datasets have been conducted to show the effectiveness and efficiency of our GMKL.

Group-Sensitive Multiple Kernel Learning for Object Recognition

Generalized Convexity-Based Inexact Projection Method for Multiple Kernel Learning

Image Annotation by the Multiple Kernel Learning with Group Sparsity Effect

Multiple graph kernel learning based on GMDH-type neural network

Per-sample Multiple Kernel Approach for Visual Concept Learning

Multiple Kernel Active Learning for Image Classification

Localized Multiple Kernel Learning for Realistic Human Action Recognition in Videos

MKEL: Multiple Kernel Ensemble Learning via Unified Ensemble Loss for Image Classification

Group-based local adaptive deep multiple kernel learning with lp norm

Image Set Classification Using Holistic Multiple Order Statistics Features and Localized Multi-kernel Metric Learning

Concurrent Multiple Instance Learning For Image Categorization

Multiple Kernel Learning with NOn-conVex Group Sparsity

Two-stage multiple kernel learning with multiclass kernel polarization.

Optimization-based Multikernel Extreme Learning for Multimodal Object Image Classification

Multiple Kernel Subspace Learning for Clustering and Classification

Fast Multi-View Segment Graph Kernel for Object Classification

Multiple Kernel Clustering Based on Centered Kernel Alignment

Finding Optimal Combination of Kernels using Genetic Programming

Consensus Local Graph for Multiple Kernel Clustering

Efficient sparse generalized multiple kernel learning

Multiple kernel learning via orthogonal neighborhood preserving projection and maximum margin criterion method for synthetic aperture radar target recognition