To Solve Kernel Principal Component Analysis Using Iterative Method

SHI Wei-ya,GUO Yue-fei
2013-01-01
Abstract:Kernel Principal Component Analysis(KPCA) is the generalized algorithm of famous Principal Component Analysis(PCA),which uses the kernel method and treats with the complex nonlinear dataset.It firstly computes the kernel matrix between mapped samples in high dimensional space,and uses eigen-decomposition technique to compute the eigen-solution for kernel matrix.The space and time complexity of the KPCA is O(m2) and O(m3),respectively.When faced with large-scale data set,the method is infeasible for the sake of the storage and computational problem.In this paper,the Power iteration is introduced to compute the highest eigen-solution.Then the Schur-Weilandt deflation is repeatedly applied to achieve other higher order eigenvectors.In the process of computation,the kernel matrix needs not to compute and store in advance.The space complexity of the proposed method is only O(m).The effectiveness of proposed method is validated from experimental results on toy and real dataset.
What problem does this paper attempt to address?