Abstract:Multiple Kernel Learning (MKL) has been demonstrated to improve classification performance effectively. But it will cause a large complexity in some large-scale cases. In this paper, we aim to reduce both the time and space complexities of MKL, and thus propose an efficient multi-kernel classification machine based on the Nyström approximation. Firstly, we generate different kernel matrices Kps for given data. Secondly, we apply the Nyström approximation technique into each Kp so as to obtain its corresponding approximation matrix K∼p. Thirdly, we fuse multiple generated K∼ps into the final ensemble matrix G∼ with one certain heuristic rule. Finally, we select the Kernelized Modification of Ho–Kashyap algorithm with Squared approximation of the misclassification errors (KMHKS) as the incorporated paradigm, and meanwhile apply the G∼ into KMHKS. In doing so, we propose a multi-kernel classification machine with reduced complexity named Nyström approximation matrix with Multiple KMHKSs (NMKMHKS). The experimental results here validate both the effectiveness and efficiency of the proposed NMKMHKS. The contributions of NMKMHKS are that: (1) compared with the existing MKL, NMKMHKS reduces the computational complexity of finding the solution scale from O(Mn3) to O(Mnm2), where M is the number of kernels, n is the number of training samples, and m is the number of the selected columns from Kp. Meanwhile, NMKMHKS reduces the space complexity of storing the kernel matrices from O(Mn2) to O(n2); (2) compared with the original KMHKS, NMKMHKS improves the classification performance but keeps a comparable space complexity; (3) the better recognition of NMKMHKS can be got in a strong correlation between multiple used Kps; and (4) NMKMHKS has a tighter generalization risk bound in terms of the Rademacher complexity analysis.

Multi-Kernel Transfer Extreme Learning Classification

Multiple-kernel-learning-based Extreme Learning Machine for Classification Design

Extreme Learning Machine Based Transfer Learning for Data Classification.

Extreme Learning Machine with Multiple Kernels

Multi-class AdaBoost ELM

Optimization-Based Extreme Learning Machine with Multi-kernel Learning Approach for Classification

Extreme Learning Machine Combining Hidden-Layer Feature Weighting and Batch Training for Classification

Optimization-based Multikernel Extreme Learning for Multimodal Object Image Classification

Twin Extreme Learning Machines For Pattern Classification

MKEL: Multiple Kernel Ensemble Learning via Unified Ensemble Loss for Image Classification

MK-MSMCR: An efficient multiple kernel approach to multi-class classification

Domain Adaptation Based on Semi-Supervised Cross-Domain Mean Discriminative Analysis and Kernel Transfer Extreme Learning Machine

Mixture Correntropy-Based Kernel Extreme Learning Machines

A robust image classification scheme with sparse coding and multiple kernel learning

Extreme Learning Machine with Kernel Model Based on Deep Learning

A Novel Extreme Learning Machine Based on Hybrid Kernel Function.

Image classification using multiple kernel learning and sparse coding

Multi-Label Classification Method Based on Extreme Learning Machines

Enhanced Kernel-Based Multilayer Fuzzy Weighted Extreme Learning Machines

Collaborative and Geometric Multi-Kernel Learning for Multi-Class Classification

Multi-kernel Classification Machine with Reduced Complexity