Least Squares Hidden Space Support Vector Machines

WANG Ling,BO Lie-Feng,LIU Fang,JIAO Li-Cheng
DOI: https://doi.org/10.3321/j.issn:0254-4164.2005.08.007
2005-01-01
Chinese Journal of Computers
Abstract:Utilizing least squares loss function in the hidden space, least squares hidden space support vector machines (LSHSSVMs) are proposed in this paper. Like in the hidden space support vector machines (HSSVMs), the kernel functions used in LSHSSVMs are not necessary to satisfy the positive definite condition, so they can be chosen from a wide range. Due to the adoption of the least squares loss function, LSHSSVMs result in an unconstrained convex quadratic programming, which is more convenient to solve than the constrained convex quadratic programming yielded by HSSVMs. A conjugate gradient algorithm is designed to efficiently solve LSHSSVMs, and an analysis of computation time is also given. The comparative experimental results on pattern recognition and function regression show some advantages of LSHSSVMs over HSSVMs on the computational complexity and the generalization performance.
What problem does this paper attempt to address?