Abstract:Principal component analysis (PCA) has been proven to be an efficient method in dimensionality reduction, feature extraction and pattern recognition. Kernel principal component analysis (KPCA) can be considered as a natural nonlinear generalization of PCA, which performs linear PCA in a high dimensional space implicitly by using kernel trick. However, both conventional PCA and KPCA suffer from the deficiency of being sensitive to outliers. Existing robust KPCA has to eigen-decompose the gram matrix directly in each step and is much more computationally infeasible due to the large size of the matrix when the number of training samples is large. By extending existing robust PCA algorithm using kernel methods, we present a novel robust adaptive algorithm for calculating the kernel principal components. The proposed method not only preserves the characteristic of capturing underlying nonlinear structure of KPCA but also is robust against outliers by restraining the effect of outlying samples. Compared with existing robust KPCA methods, our method is performed without having to store the kernel matrix, which can reduce significantly the storage burden. In addition, our method shows the potential of expansibility to the incremental learning version. Experimental results on synthetic data indicate that our improved algorithm is effective and promising.

Nonlinear Component Analysis as a Kernel Eigenvalue Problem

Preservation of Local Linearity by Neighborhood Subspace Scaling for Solving the Pre-Image Problem.

Developments and Applications of Nonlinear Principal Component Analysis – a Review

Nonlinear Component Analysis for Large-Scale Data Set Using Fixed-Point Algorithm

Adaptive Kpca Modeling of Nonlinear Systems

Block Adaptive Kernel Principal Component Analysis for Nonlinear Process Monitoring

An Infinite Dimensional Analysis of Kernel Principal Components

Nonlinear Process Monitoring Using Improved Kernel Principal Component Analysis

A Comparative Study of Two Kernel Ideas for Nonlinear Feature Extraction

Phase Space Reconstruction of Nonlinear Time Series Based on Kernel Method

On Feature Extraction Via Kernels

Sparse Kernel Extreme Components Analysis

To Solve Kernel Principal Component Analysis Using Iterative Method

Kernel Principal Component Analysis and its Applications in Face Recognition and Active Shape Models

An Iterative Algorithm for Robust Kernel Principal Component Analysis

Incomplete Cholesky Decomposition Based Kernel Principal Component Analysis For Large-Scale Data Set

Kernel Generalized Nonlinear Discriminant Analysis Algorithm For Pattern Recognition

Kernel Additive Principal Components

Kernel-OPBS Algorithm: A Nonlinear Feature Selection Method for Hyperspectral Imagery

A Kernel Spatial Complexity-Based Nonlinear Unmixing Method of Hyperspectral Imagery.

Adaptive kernel subspace method for speeding up feature extraction