Abstract:We modify the conventional principal component analysis (PCA) and propose a novel subspace learning framework, modified PCA (MPCA), using multiple similarity measurements. MPCA computes three similarity matrices exploiting the similarity measurements: 1) mutual information; 2) angle information; and 3) Gaussian kernel similarity. We employ the eigenvectors of similarity matrices to produce new subspaces, referred to as similarity subspaces. A new integrated similarity subspace is then generated using a novel feature selection approach. This approach needs to construct a kind of vector set, termed weak machine cell (WMC), which contains an appropriate number of the eigenvectors spanning the similarity subspaces. Combining the wrapper method and the forward selection scheme, MPCA selects a WMC at a time that has a powerful discriminative capability to classify samples. MPCA is very suitable for the application scenarios in which the number of the training samples is less than the data dimensionality. MPCA outperforms the other state-of-the-art PCA-based methods in terms of both classification accuracy and clustering result. In addition, MPCA can be applied to face image reconstruction. MPCA can use other types of similarity measurements. Extensive experiments on many popular real-world data sets, such as face databases, show that MPCA achieves desirable classification results, as well as has a powerful capability to represent data.

EVALUATE DISSIMILARITY OF SAMPLES IN FEATURE SPACE FOR IMPROVING KPCA

Algorithm Design for Improving Feature Extraction Efficiency Based on KPCA

Adaptive kernel subspace method for speeding up feature extraction

A method for speeding up feature extraction based on KPCA

Efficient Kpca-Based Feature Extraction: A Novel Algorithm And Experiments

U^2F^2S^2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection

KPCA Based on Feature Samples for Fault Detection

A Fast KPCA-based Nonlinear Feature Extraction Method

Data-Dependent Kernel Discriminant Analysis for Feature Extraction and Classification

Producing computationally efficient KPCA-based feature extraction for classification problems

Sparse Data-Dependent Kernel Principal Component Analysis Based on Least Squares Support Vector Machine for Feature Extraction and Recognition.

A Dimensionality Reduction Method Based on KPCA with Optimized Sample Set for Hyperspectral Image

Sample Weighting: an Inherent Approach for Outlier Suppressing Discriminant Analysis

Modified Principal Component Analysis: an Integration of Multiple Similarity Subspace Models.

KPCA Based on Cultural Algorithms Feature Extraction

On Feature Extraction Via Kernels

Comparative Analysis of 2D-PCA Based Dimensionality Reduction and Feature Extraction

A New Hybrid Collaborative Filtering Algorithm

Robust kernel discriminant analysis and its application to feature extraction and recognition

Discriminant similarity and variance preserving projection for feature extraction

A SSVM-Based Recursive Uncorrelated Feature Extraction Algorithm