Kernel discriminant analysis based on support vectors

ZHANG Bao-Chang,CHEN Xi-Lin,SHAN Shi-Guang,Wen Gao
2006-01-01
Jisuanji Xuebao/Chinese Journal of Computers
Abstract:Discriminant analysis is one of crucial issues for the statistic-based face recognition methods. This paper proposes a novel Support Vectors based Kernel Fisher Discriminant analysis method (SV-KFD) for face recognition, which has combined the idea of the Support Vector Machine (SVM) and kernel Fisher analysis. The authors first discuss the relationship between SVM and kernel Fisher analysis. Based on the intrinsic nullspace property of the SVM proven by the authors, which shows that the normal vector of the SVM decision plane is of the nullspace property in terms of the support vectors-based within-class scatter matrix, a support vectors-based method is presented to construct the Kernelized Decision Boundary Feature Matrix (KDBFM) by using the SVM normal vectors. Furthermore the difference vector of the mean support vectors is combined to construct the Extended Kernelized Decision Boundary Feature Matrix (Ex-KDBFM). Finally, the nullspace Kernel Fisher method is exploited to seek the projection space, which is used to extract the discriminant features from the original face images. In addition, the proposed discriminant method includes two steps, and the tedious singularity problem can be avoided. The proposed method is applied on face recognition, and the experimental results on the FERET and CAS-PEAL-R1 databases show that it performs much better than the traditional kernel discriminant analysis methods in terms of the recognition rate.
What problem does this paper attempt to address?