Abstract:We modify the conventional principal component analysis (PCA) and propose a novel subspace learning framework, modified PCA (MPCA), using multiple similarity measurements. MPCA computes three similarity matrices exploiting the similarity measurements: 1) mutual information; 2) angle information; and 3) Gaussian kernel similarity. We employ the eigenvectors of similarity matrices to produce new subspaces, referred to as similarity subspaces. A new integrated similarity subspace is then generated using a novel feature selection approach. This approach needs to construct a kind of vector set, termed weak machine cell (WMC), which contains an appropriate number of the eigenvectors spanning the similarity subspaces. Combining the wrapper method and the forward selection scheme, MPCA selects a WMC at a time that has a powerful discriminative capability to classify samples. MPCA is very suitable for the application scenarios in which the number of the training samples is less than the data dimensionality. MPCA outperforms the other state-of-the-art PCA-based methods in terms of both classification accuracy and clustering result. In addition, MPCA can be applied to face image reconstruction. MPCA can use other types of similarity measurements. Extensive experiments on many popular real-world data sets, such as face databases, show that MPCA achieves desirable classification results, as well as has a powerful capability to represent data.

Discriminative Vanishing Component Analysis

Discriminant Common Vectors in Principal Component Analysis Transformed Space for Face Recognition

Distance-Based Classifier Via the Kernel Trick.

Data-Dependent Kernel Discriminant Analysis for Feature Extraction and Classification

Supervised Dimensionality Reduction Technology of Generalized Discriminant Component Analysis and Its Kernelization Forms

Discriminant Independent Component Analysis As a Subspace Representation

Adaptive quasiconformal kernel discriminant analysis

Dimensionality Reduction by Mixed Kernel Canonical Correlation Analysis

Nonlinear Canonical Correlation Analysis for Discrimination Based on Kernel Methods

Nonlinear Process Monitoring Using Improved Kernel Principal Component Analysis

Sparse Kernel Extreme Components Analysis

Multi-view Common Component Discriminant Analysis for Cross-view Classification

Robust kernel discriminant analysis and its application to feature extraction and recognition

Discriminant analysis via support vectors

Smoothed separable nonnegative matrix factorization

Sparse Data-Dependent Kernel Principal Component Analysis Based on Least Squares Support Vector Machine for Feature Extraction and Recognition.

Discriminative Feature Fusion Based on Extensions of PCA

Uncorrelated discriminant vectors using a kernel method

Discriminative Principal Component Analysis: A REVERSE THINKING

Modified Principal Component Analysis: an Integration of Multiple Similarity Subspace Models.

Transductive Component Analysis