Abstract:Multiple kernel learning (MKL) is demonstrated to be flexible and effective in depicting heterogeneous data sources since MKL can introduce multiple kernels rather than a single fixed kernel into applications. However, MKL would get a high time and space complexity in contrast to single kernel learning, which is not expected in real-world applications. Meanwhile, it is known that the kernel mapping ways of MKL generally have two forms including implicit kernel mapping and empirical kernel mapping (EKM), where the latter is less attracted. In this paper, we focus on the MKL with the EKM, and propose a reduced multiple empirical kernel learning machine named RMEKLM for short. To the best of our knowledge, it is the first to reduce both time and space complexity of the MKL with EKM. Different from the existing MKL, the proposed RMEKLM adopts the Gauss Elimination technique to extract a set of feature vectors, which is validated that doing so does not lose much information of the original feature space. Then RMEKLM adopts the extracted feature vectors to span a reduced orthonormal subspace of the feature space, which is visualized in terms of the geometry structure. It can be demonstrated that the spanned subspace is isomorphic to the original feature space, which means that the dot product of two vectors in the original feature space is equal to that of the two corresponding vectors in the generated orthonormal subspace. More importantly, the proposed RMEKLM brings a simpler computation and meanwhile needs a less storage space, especially in the processing of testing. Finally, the experimental results show that RMEKLM owns a much efficient and effective performance in terms of both complexity and classification. The contributions of this paper can be given as follows: (1) by mapping the input space into an orthonormal subspace, the geometry of the generated subspace is visualized; (2) this paper first reduces both the time and space complexity of the EKM-based MKL; (3) this paper adopts the Gauss Elimination, one of the on-the-shelf techniques, to generate a basis of the original feature space, which is stable and efficient.

MKLpy: a python-based framework for Multiple Kernel Learning

Generalized Convexity-Based Inexact Projection Method for Multiple Kernel Learning

Multiple-kernel-learning-based Extreme Learning Machine for Classification Design

Two-stage multiple kernel learning with multiclass kernel polarization.

Multiple Kernel Subspace Learning for Clustering and Classification

A novel graph-based multiple kernel learning framework for hyperspectral image classification

Supervised Multiple Kernel Learning approaches for multi-omics data integration

Multiple Empirical Kernel Learning with Locality Preserving Constraint

Structural multiple empirical kernel learning

Unsupervised MKL in Multi-layer Kernel Machines

A simple yet efficient algorithm for multiple kernel learning under elastic-net constraints

Enhancing deep neural networks via multiple kernel learning

Per-sample Multiple Kernel Approach for Visual Concept Learning

Neural Generalization of Multiple Kernel Learning

Efficient sparse generalized multiple kernel learning

SimpleMKKM: Simple Multiple Kernel K-Means

Ideal Kernel-Based Multiple Kernel Learning for Spectral-Spatial Classification of Hyperspectral Image.

Multiple Kernel Clustering Based on Centered Kernel Alignment

Self-weighted Multiple Kernel Learning for Graph-Based Clustering and Semi-Supervised Classification

Reduced Multiple Empirical Kernel Learning Machine

Probability-confidence-kernel-based localized multiple kernel learning with l p norm