Local Fisher Discriminant Analysis with Locally Linear Embedding Affinity Matrix

Yue Zhao,Jinwen Ma
DOI: https://doi.org/10.1007/978-3-642-39065-4_57
2013-01-01
Abstract:Fisher Discriminant Analysis (FDA) is a popular method for dimensionality reduction. Local Fisher Discriminant Analysis (LFDA) is an improvement of FDA, which can preserve the local structures of the feature space in multi-class cases. However, the affinity matrix in LFDA cannot reflect the actual interrelationship among all the neighbors for each sample point. In this paper, we propose a new LFDA approach with the affinity matrix being solved by the locally linear embedding (LLE) method to preserve the particular local structures of the specific feature space. Moreover, for nonlinear cases, we extend this new LFDA method to the kernelized version by using the kernel trick. It is demonstrated by the experiments on five real-world datasets that our proposed LFDA methods with LLE affinity matrix are applicable and effective.
What problem does this paper attempt to address?