Abstract:The kernel method suffers from the following problem: the computational efficiency of the feature extraction procedure is inversely proportional to the size of the training sample set. In this paper, from a novel viewpoint, we propose a very simple and mathematically tractable method to produce the computationally efficient kernel-method-based feature extraction procedure. We first address the issue that how to make the feature extraction result of the reformulated kernel method well approximate that of the naïve kernel method. We identify these training samples that statistically contribute much to the feature extraction results and exploit them to reformulate the kernel method to produce the computationally efficient kernel-method-based feature extraction procedure. Indeed, the proposed method has the following basic idea: when one training sample has little effect on the feature extraction result and statistically has the high correlation with regard to all the training samples, the feature extraction term associated with this training sample can be removed from the feature extraction procedure. The proposed method has the following advantages: First, it proposes, for the first time, to improve the kernel method through formal and reasonable evaluation on the feature extraction term. Second, the proposed method improves the kernel method at a low extra cost and thus has a much more computationally efficient training phase than most of the previous improvements to the kernel method. The experimental comparison shows that the proposed method performs well in classification problems. This paper also intuitively shows the geometrical relation between the identified training samples and other training samples.

A method for speeding up feature extraction based on KPCA

Adaptive kernel subspace method for speeding up feature extraction

Efficient Kpca-Based Feature Extraction: A Novel Algorithm And Experiments

A Fast KPCA-based Nonlinear Feature Extraction Method

Algorithm Design for Improving Feature Extraction Efficiency Based on KPCA

Producing computationally efficient KPCA-based feature extraction for classification problems

Improved <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" id="M1"><mml:mrow><mml:mi>k</mml:mi></mml:mrow></mml:math>-<mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" id="M2"><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:math> PCA Algorithm Using Artificial Sparsity in Dynamic MRI

Cross-validatory Framework for Optimal Parameter Estimation of KPCA and KPLS Models

EVALUATE DISSIMILARITY OF SAMPLES IN FEATURE SPACE FOR IMPROVING KPCA

Adaptive Kpca Modeling of Nonlinear Systems

KPCA Based on Feature Samples for Fault Detection

Accelerating the Kernel-Method-based Feature Extraction Procedure from the Viewpoint of Numerical Approximation

MODIFIED KERNEL-BASED NONLINEAR FEATURE EXTRACTION

Modified Kernel-Based Nonlinear Feature Extraction [face Recognition Example]

Fast Implementation of Kernel Simplex Volume Analysis Based on Modified Cholesky Factorization for Endmember Extraction

An Iterative Algorithm for Robust Kernel Principal Component Analysis

KPCA Based on Cultural Algorithms Feature Extraction

Fast Feature Extraction Based on Multi-feature Classification for Color Image.

Optimization Of Principal Component Analysis In Feature Extraction

A Fast Feature Extraction Method.

A Framework of Sparse Kernel Principal Component Analysis and Its Applications