Abstract:Kernel methods have been successfully applied in various applications. To succeed in these applications, it is crucial to learn a good kernel representation, whose objective is to reveal the data similarity precisely. In this paper, we address the problem of multiple kernel learning (MKL), searching for the optimal kernel combination weights through maximizing a generalized performance measure. Most MKL methods employ the L(1)-norm simplex constraints on the kernel combination weights, which therefore involve a sparse but non-smooth solution for the kernel weights. Despite the success of their efficiency, they tend to discard informative complementary or orthogonal base kernels and yield degenerated generalization performance. Alternatively, imposing the L(p)-norm (p > 1) constraint on the kernel weights will keep all the information in the base kernels. This leads to non-sparse solutions and brings the risk of being sensitive to noise and incorporating redundant information. To tackle these problems, we propose a generalized MKL (GMKL) model by introducing an elastic-net-type constraint on the kernel weights. More specifically, it is an MKL model with a constraint on a linear combination of the L(1)-norm and the squared L(2)-norm on the kernel weights to seek the optimal kernel combination weights. Therefore, previous MKL problems based on the L(1)-norm or the L(2)-norm constraints can be regarded as special cases. Furthermore, our GMKL enjoys the favorable sparsity property on the solution and also facilitates the grouping effect. Moreover, the optimization of our GMKL is a convex optimization problem, where a local solution is the global optimal solution. We further derive a level method to efficiently solve the optimization problem. A series of experiments on both synthetic and real-world datasets have been conducted to show the effectiveness and efficiency of our GMKL.

Kernel Recursive Generalized Mixed Norm Algorithm

Kernel Least-Mean Mixed-Norm Algorithm

A Kernel Normalized Data-Reusing Generalized Maximum Correntropy Algorithm

The Generalized Complex Kernel Affine Projection Algorithms

Generalized mixed-norm maximum correntropy for robust adaptive filtering

Robust Kernel Recursive Adaptive Filtering Algorithms Based on M-estimate

A Generalized t-Distribution-Based Kernel Adaptive Filtering Algorithm

Laguerre Kernel Adaptive Filter With Arctangent Criterion for Nonlinear System Identification

Study of Set-Membership Adaptive Kernel Algorithms

Recursive filtering with non-Gaussian noises

Adaptive Kernel Leaning Networks with Application to Nonlinear System Identification

CGNR is an Error Reducing Algorithm.

General Cauchy Conjugate Gradient Algorithms Based on Multiple Random Fourier Features

Kernel Adaptive Filtering Over Complex Networks

A Kernel Recursive Mixed Error Criterion Algorithm for Chaotic Time Series Prediction

Efficient sparse generalized multiple kernel learning

New Normalized LMS Adaptive Filter with a Variable Regularization Factor

Affine projection mixed-norm algorithms for robust filtering

The Kernel Conjugate Gradient Algorithms.

Kernel Mixture Correntropy Conjugate Gradient Algorithm for Time Series Prediction

GMKF: Generalized Moment Kalman Filter for Polynomial Systems with Arbitrary Noise