Abstract:Multiple Kernel Learning (MKL) is flexible in dealing with problems involving multiple and heterogeneous data sources. However, the necessity of inner-product form restricts its application since to kernelize the algorithms unsatisfying the inner-product formulation is pretty difficult. To overcome this problem, Multiple Empirical Kernel Learning (MEKL) is proposed by explicitly mapping input samples to feature spaces, in which the mapped feature vectors are explicitly presented. Most existed MEKLs optimize the learning framework by minimizing empirical risk, regularization risk and the loss term of multiple feature spaces. As little attention is paid to preserving local structure among training samples, the learned classifier might lack of locality similarity preserving property, which might result in unfavorable performance. Inspired by Locality Preserving Projection (LPP) which is to seek the optimal projection by preserving the local property of input samples, we introduce the locality preserving constraint into the learning framework to propose a novel Multiple Empirical Kernel Learning with Locality Preserving Constraint (MEKL-LPC). MEKL-LPC shows lower generalization error bound than both the Modification of Ho–Kashyap algorithm with Squared approximation of the misclassification error (MHKS) and Multi-Kernel MHKS (MultiK-MHKS) in terms of Rademacher complexity. Experiments on several real-world datasets demonstrate that MEKL-LPC outperforms the compared algorithms. The contributions of this work are: (i) originally integrating locality preserving constraint into MEKL, (ii) proposing a lower generalization error bound algorithm, i.e. MEKL-LPC.

Learning performance of regularized regression with multiscale kernels based on Markov observations

Local Linear M‐estimation in Non‐parametric Spatial Regression

The Generalization Performance of Regularized Regression Algorithms Based on Markov Sampling

Generalization Performance of Gaussian Kernels SVMC Based on Markov Sampling.

Regularization Strategies and Empirical Bayesian Learning for MKL

Learning from uniformly ergodic Markov chains

Generalization Performance of Regularized Ranking with Multiscale Kernels

Bayesian Modular and Multiscale Regression

Multiscale regression on unknown manifolds

The Learning Performance of Support Vector Machine Classification Based on Markov Sampling

Probability-confidence-kernel-based localized multiple kernel learning with l p norm

Sparse Estimator with $\ell_0$ -Norm Constraint Kernel Maximum-Correntropy-Criterion

The Generalization Ability of SVM Classification Based on Markov Sampling

Multiple Empirical Kernel Learning with Locality Preserving Constraint

Analysis of Least Squares Regularized Regression in Reproducing Kernel Krein Spaces

Variational Multiscale Nonparametric Regression: Smooth Functions

Precise Error Analysis of Regularized M-estimators in High-dimensions

Analysis of Regularized Nyström Subsampling for Regression Functions of Low Smoothness

Consistency of Multiple Kernel Clustering.

Concentration Estimates for Learning with ℓ1-Regularizer and Data Dependent Hypothesis Spaces

M-Power Regularized Least Squares Regression