Abstract:Multiple kernel learning (MKL) is demonstrated to be flexible and effective in depicting heterogeneous data sources since MKL can introduce multiple kernels rather than a single fixed kernel into applications. However, MKL would get a high time and space complexity in contrast to single kernel learning, which is not expected in real-world applications. Meanwhile, it is known that the kernel mapping ways of MKL generally have two forms including implicit kernel mapping and empirical kernel mapping (EKM), where the latter is less attracted. In this paper, we focus on the MKL with the EKM, and propose a reduced multiple empirical kernel learning machine named RMEKLM for short. To the best of our knowledge, it is the first to reduce both time and space complexity of the MKL with EKM. Different from the existing MKL, the proposed RMEKLM adopts the Gauss Elimination technique to extract a set of feature vectors, which is validated that doing so does not lose much information of the original feature space. Then RMEKLM adopts the extracted feature vectors to span a reduced orthonormal subspace of the feature space, which is visualized in terms of the geometry structure. It can be demonstrated that the spanned subspace is isomorphic to the original feature space, which means that the dot product of two vectors in the original feature space is equal to that of the two corresponding vectors in the generated orthonormal subspace. More importantly, the proposed RMEKLM brings a simpler computation and meanwhile needs a less storage space, especially in the processing of testing. Finally, the experimental results show that RMEKLM owns a much efficient and effective performance in terms of both complexity and classification. The contributions of this paper can be given as follows: (1) by mapping the input space into an orthonormal subspace, the geometry of the generated subspace is visualized; (2) this paper first reduces both the time and space complexity of the EKM-based MKL; (3) this paper adopts the Gauss Elimination, one of the on-the-shelf techniques, to generate a basis of the original feature space, which is stable and efficient.

An Efficient Multiple Kernel Learning in Reproducing Kernel Hilbert Spaces (RKHS).

Generalized Convexity-Based Inexact Projection Method for Multiple Kernel Learning

A Local-Global Mixed Kernel with Reproducing Property

Efficient Multiple Kernel Learning Algorithms Using Low-Rank Representation.

A Multiple Attributes Convolution Kernel with Reproducing Property

Reproducing kernel Banach spaces for machine learning

RKHS reconstruction based on manifold learning for high-dimensional data

A Novel Description of the Reproducing Kernel Support Vector Machines

Reproducing kernel technique for high dimensional model representations (HDMR).

Eigenfunction-Based Multitask Learning in a Reproducing Kernel Hilbert Space.

Learning in RKHM: a $C^*$-Algebraic Twist for Kernel Machines

An Efficient and Effective Multiple Empirical Kernel Learning Based on Random Projection

An efficient multiple kernel computation method for regression analysis of economic data

Representative Multiple Kernel Learning for Classification in Hyperspectral Imagery

An Online Multiple Kernel Parallelizable Learning Scheme

Ideal Kernel-Based Multiple Kernel Learning for Spectral-Spatial Classification of Hyperspectral Image.

Multiple Kernel Spectral Regression for Dimensionality Reduction

Vector-valued Reproducing Kernel Banach Spaces with Applications to Multi-task Learning

Multiple Kernel Subspace Learning for Clustering and Classification

Reduced Multiple Empirical Kernel Learning Machine

Multiple Kernel Sparse Representation-Based Orthogonal Discriminative Projection and Its Cost-Sensitive Extension.