Semi-supervised Kernel Fisher Discriminant Analysis Based on Exponential-Adjusted Geometric Distance
Zhiyu Chen,Yuqi Sun,Dongliang Hu,Yangguang Bian,Shensen Wang,Xiyuan Zhang,Xinmin Tao
DOI: https://doi.org/10.1007/s00521-024-09768-x
2024-01-01
Neural Computing and Applications
Abstract:Fisher discriminant analysis (FDA) is a widely used dimensionality reduction tool in pattern recognition. However, FDA cannot obtain an optimal subspace for classification without sufficient labeled samples. Thus, semi-supervised discriminant analysis has attracted great attention in recent years. In this paper, the proposed method employs the exponential-adjusted geometric distance as the measure of similarity, which modifies the exponential function and the scaling factor. The distance not only satisfies the global and local consistency requirements, but also the similarity matrix obtained is more consistent with the real data distribution, thus improves the dimensionality reduction performance. First, in order to deal with the nonlinear separated data, the kernel function is used to map the original data into the high-dimensional feature space. Then, both labeled and unlabeled data in feature space are used to capture the consistence assumption of geometrical structure based on exponential-adjusted geometric distance, which are incorporated into the objection function of local Fisher discriminant analysis as a regularization term. Eventually, the optimal projection matrix is obtained by maximizing the objective function. Experiments on artificial datasets, UCI benchmark datasets, and high-dimensional recognition problems indicate that the presented technique has a significantly improvement in discriminant performance compared with the-state-of-art dimensionality reduction techniques.