A SSVM-Based Recursive Uncorrelated Feature Extraction Algorithm

Xiaobing Ren
2011-01-01
Chinese Journal of Computers
Abstract:A feature extraction algorithm for high dimensional data with unknown distribution and small sample size problem is discussed in this paper.Based on support vector machines and the idea of uncorrelated features,a scatter support vector machine(SSVM)-based recursive uncorrelated feature extraction algorithm is presented to deal with drawbacks of existing algorithms,such as correlations among extracted features,performance decrease from distribution of samples etc.To cope with small sample size problem,the optimization problem of SSVM is transformed into that in isomorphic lower dimension space through PCA;Then the method of recursively extracting margin discriminant vectors is proposed,and the uncorrelated features can be yielded by projecting the data in margin discriminant vectors;Finally,the convergence and termination condition of the proposed algorithm are analyzed.The algorithm can be generalized into nonlinear cases through kernel methods,the optimization problem of nonlinear SSVM can be transformed into equivlent optimization problem in lower dimension through KPCA,and then uncorrelated nonlinear features can be extracted.The simulation results demonstrate the efficiencies of the proposed algorithm.
What problem does this paper attempt to address?