Reduced Least Squares Support Vector Machine Optimized by Differential Evolution

GAO Runpeng,SAN Ye
DOI: https://doi.org/10.3969/j.issn.1006-7043.2011.08.009
2011-01-01
Abstract:Aiming at lack of sparseness of the solutions of least squares support vector regression machine which leads to slow prediction speed and other problems,the vector correlation analysis was employed to reduce the support vectors in the high dimensional feature space.In order to make the reduced model best approximate the original one,sum squared prediction errors of training samples between the reduced model and original one were taken as the novel performance evaluation criterion.Discrete addition,subtraction and multiplication operator were defined and the novel performance evaluation criterion was used as fitness function.The best reduced model globally optimized by integer coded differential evolution algorithm could be obtained.The experimental results on four benchmark datasets show that reduced model obtained by the novel algorithm has better generalization performance,compared with the other three performance evaluation criterions presented before.And reduced model obviously decreases support vectors at cost of little generalization performance.
What problem does this paper attempt to address?