Nonlinear Canonical Correlation Analysis for Discrimination Based on Kernel Methods

孙平,徐宗本,申建中
DOI: https://doi.org/10.3321/j.issn:0254-4164.2004.06.010
2004-01-01
Jisuanji Xuebao/Chinese Journal of Computers
Abstract:In this paper, we generalize the Canonical Correlation Analysis (CCA)) for discrimination to yield a new nonlinear learning machine by using kernel methods. It is named as Kernel Canonical Correlation Discriminant Analysis (KCCDA), which is a powerful technique for extracting nonlinear features from high-dimensional data sets. To overcome the problems of computation complexity, an adaptive learning algorithm for KCCDA is proposed based on online sparsification. The extensive experiments on artificial and real-world data sets demonstrate the competitiveness of KCCDA and our adaptive learning algorithm. Finally, from the theoretical viewpoint we prove that KCCDA is identical to the Kernel Fisher Discriminant analysis (KFD) except for an unimportant scale factor.
What problem does this paper attempt to address?