The Theory of Canonical Correlation Analysis and Its Application to Feature Fusion

Quan-Sen SUN,Sheng-Gen ZENG,Pheng-Ann HENG,De-Shen XIA
DOI: https://doi.org/10.3321/j.issn:0254-4164.2005.09.015
2005-01-01
Jisuanji Xuebao/Chinese Journal of Computers
Abstract:In this paper, based on feature fusion, a new method of feature extraction is proposed according to the idea of canonical correlation analysis. At first, the framework of canonical correlation analysis (CCA) used in pattern recognition is discussed and its reasonable description is given. This comprises three steps: extracting two sets of feature vectors with the same pattern and establishing the correlation criterion function between the two sets of feature vectors; solving the two sets canonical projective vectors and extracting their canonical correlation features by the CCA algorithm; doing feature fusion for classification by using proposed strategy. Then, the problem of canonical projection vectors is solved when two covariance matrices of training samples are singular. This method is adapted to small sample size and high-dimensional problems, so the applicable range of CCA is extended in theory. At last, the inherent essence of this method used in recognition is analyzed further in theory. The proposed method uses correlation features of two groups of feature vectors as effective discriminant information, so it not only is suitable for information fusion, but also eliminates the redundant information within the features. This is a new way to classification and recognition. The experiment results on the CENPARMI handwritten Arabic numerals database of Concordia University and FERET face image database show that recognition rate is far higher than that of the algorithm adopting the single feature or the existing fusion algorithm, and that this algorithm is efficient and robust.
What problem does this paper attempt to address?