Abstract:The kernel method suffers from the following problem: the computational efficiency of the feature extraction procedure is inversely proportional to the size of the training sample set. In this paper, from a novel viewpoint, we propose a very simple and mathematically tractable method to produce the computationally efficient kernel-method-based feature extraction procedure. We first address the issue that how to make the feature extraction result of the reformulated kernel method well approximate that of the naïve kernel method. We identify these training samples that statistically contribute much to the feature extraction results and exploit them to reformulate the kernel method to produce the computationally efficient kernel-method-based feature extraction procedure. Indeed, the proposed method has the following basic idea: when one training sample has little effect on the feature extraction result and statistically has the high correlation with regard to all the training samples, the feature extraction term associated with this training sample can be removed from the feature extraction procedure. The proposed method has the following advantages: First, it proposes, for the first time, to improve the kernel method through formal and reasonable evaluation on the feature extraction term. Second, the proposed method improves the kernel method at a low extra cost and thus has a much more computationally efficient training phase than most of the previous improvements to the kernel method. The experimental comparison shows that the proposed method performs well in classification problems. This paper also intuitively shows the geometrical relation between the identified training samples and other training samples.

Algorithm Design for Improving Feature Extraction Efficiency Based on KPCA

Efficient Kpca-Based Feature Extraction: A Novel Algorithm And Experiments

Adaptive kernel subspace method for speeding up feature extraction

A method for speeding up feature extraction based on KPCA

A Fast KPCA-based Nonlinear Feature Extraction Method

The Optimization for Parameter of Kernel Function with GA

Producing computationally efficient KPCA-based feature extraction for classification problems

EVALUATE DISSIMILARITY OF SAMPLES IN FEATURE SPACE FOR IMPROVING KPCA

Adaptive Kpca Modeling of Nonlinear Systems

KPCA Based on Feature Samples for Fault Detection

KPCA Based on Cultural Algorithms Feature Extraction

An Iterative Algorithm for Robust Kernel Principal Component Analysis

To Solve Kernel Principal Component Analysis Using Iterative Method

On Feature Extraction Via Kernels

MODIFIED KERNEL-BASED NONLINEAR FEATURE EXTRACTION

Modified Kernel-Based Nonlinear Feature Extraction [face Recognition Example]

Accelerating the Kernel-Method-based Feature Extraction Procedure from the Viewpoint of Numerical Approximation

Nonlinear Process Monitoring Using Improved Kernel Principal Component Analysis

Sparse Data-Dependent Kernel Principal Component Analysis Based on Least Squares Support Vector Machine for Feature Extraction and Recognition.

Fast Implementation of Kernel Simplex Volume Analysis Based on Modified Cholesky Factorization for Endmember Extraction

Improved Algorithms for High-Dimensional Robust Pca