Abstract:Principal component analysis (PCA) has been proven to be an efficient method in dimensionality reduction, feature extraction and pattern recognition. Kernel principal component analysis (KPCA) can be considered as a natural nonlinear generalization of PCA, which performs linear PCA in a high dimensional space implicitly by using kernel trick. However, both conventional PCA and KPCA suffer from the deficiency of being sensitive to outliers. Existing robust KPCA has to eigen-decompose the gram matrix directly in each step and is much more computationally infeasible due to the large size of the matrix when the number of training samples is large. By extending existing robust PCA algorithm using kernel methods, we present a novel robust adaptive algorithm for calculating the kernel principal components. The proposed method not only preserves the characteristic of capturing underlying nonlinear structure of KPCA but also is robust against outliers by restraining the effect of outlying samples. Compared with existing robust KPCA methods, our method is performed without having to store the kernel matrix, which can reduce significantly the storage burden. In addition, our method shows the potential of expansibility to the incremental learning version. Experimental results on synthetic data indicate that our improved algorithm is effective and promising.

Incomplete Cholesky Decomposition Based Kernel Principal Component Analysis For Large-Scale Data Set

Matrix-based Kernel Principal Component Analysis for Large-Scale Data Set.

To Solve Kernel Principal Component Analysis Using Iterative Method

Robust Principal Component Analysis Based on Maximum Correntropy Criterion

An Iterative Algorithm for Robust Kernel Principal Component Analysis

Nonlinear Component Analysis for Large-Scale Data Set Using Fixed-Point Algorithm

Adaptive Kpca Modeling of Nonlinear Systems

An Improved Algorithm for Kernel Principal Component Analysis

K2DPCA methods for face recognition based on Cholesky decomposition

Adaptive kernel subspace method for speeding up feature extraction

KPCA Method Research and Application Process

Sparse Data-Dependent Kernel Principal Component Analysis Based on Least Squares Support Vector Machine for Feature Extraction and Recognition.

Computation and Store Space Constrained-Based Sparse Kernel Data Analysis

A Framework of Sparse Kernel Principal Component Analysis and Its Applications

Two-Phase Incremental Kernel PCA for Learning Massive or Online Datasets

Nonlinear Process Monitoring Using Improved Kernel Principal Component Analysis

A Communication-Efficient Distributed Algorithm for Kernel Principal Component Analysis.

A Covariance-Free Iterative Principal Component Analysis for High Dimensional and Large Scale Data

Adaptive Sparse Kernel Principal Component Analysis for Computation and Store Space Constrained-based Feature Extraction.

KPCA Based on Feature Samples for Fault Detection

Sparse kernel principal component algorithm based on an approximate zero norm