Abstract:Multiple Kernel Discriminant Analysis (MKDA) adopts an ensemble of multiple kernel matrices K(i)s and is supposed to be more flexible and effective than the original Kernel Discriminant Analysis (KDA). However, with n training samples and p kernel matrices K(i)s, MKDA employs pn(2) space units for all the K(i)s in the optimizing process and simultaneously depends on its solving techniques to handle the optimization problem, which would cause a large space and computational complexity and limit the efficiency and applicability. In order to mitigate this problem, this manuscript adopts the Nystrom method approximating K-i and therefore develops a novel Multiple Nystrom-Approximating Kernel Discriminant Analysis (MNKDA). In practice, the proposed MNKDA first adopts m (m << n) samples to generate an approximating kernel matrix (K-i) over tilde for each K-i and forms an ensemble matrix G = Sigma(p)(t=1)mu(t)(K-i) over tilde. Then, MNKDA directly applies the eigenvalue decomposition onto the Nystrom-based ensemble matrix G and reformulates the proposed discriminant analysis as an eigenvalue problem. The experimental results show that the proposed method can achieve an effective and efficient performance than the classical MKDA. The advantages of the proposed MNKDA are (1) expressing the formulation as an eigenvalue problem resolution instead of using commercial softwares; (2) decreasing the space complexity from O(pn(2)) to O(n(2)) and mitigating the computational complexity from O(n(3)) to O(pmn(2)); and (3) providing an alternative multiple kernel learning technique and inheriting the advantage of multiple kernel learning. (C) 2013 Elsevier B.V. All rights reserved.

Multiple Nyström Kernel Adaptive Filter under Minimum Generalized Cauchy Loss Criterion

Generalized Convexity-Based Inexact Projection Method for Multiple Kernel Learning

Nyström Kernel Algorithm under Generalized Maximum Correntropy Criterion

Nyström Kernel Algorithm Based on Least Logarithmic Hyperbolic Cosine Loss

General Cauchy Conjugate Gradient Algorithms Based on Multiple Random Fourier Features

The Nyström minimum kernel risk-sensitive loss algorithm with k-means sampling

Kernel Adaptive Filtering with Maximum Correntropy Criterion

Kernel Least Mean Square with Adaptive Kernel Size

Kernel Adaptive Filtering Under Generalized Maximum Correntropy Criterion

Single Feedback Based Kernel Generalized Maximum Correntropy Adaptive Filtering Algorithm

A Reduced Gaussian Kernel Least-Mean-Square Algorithm for Nonlinear Adaptive Signal Processing

Robust Multi-kernel Generalized Maximum Correntropy Filters

A Kernel Normalized Data-Reusing Generalized Maximum Correntropy Algorithm

A Generalized t-Distribution-Based Kernel Adaptive Filtering Algorithm

Kernel robust mixed-norm adaptive filtering

A Novel Multiple Nyström-approximating Kernel Discriminant Analysis

Nonlinear Adaptive Filtering In Kernel Spaces

Gaussian Kernel Adaptive Filters with Adaptive Kernel Bandwidth

A Quantized Kernel Learning Algorithm Using a Minimum Kernel Risk-Sensitive Loss Criterion and Bilateral Gradient Technique.

Nonlinear Multiple-Delay Feedback Based Kernel Least Mean Square Algorithm

Multi-Kernel Filtering: An Extension of Bilateral Filtering Using Image Context