Incremental Least Squares Classifier Vs.incremental Proximal Support Vector Machine

Zhenfeng Zhu,Guo Yue-fei,Xiangyang Xue

2011-01-01

Abstract:Proximal support vector machine(PSVM) and its incremental version(ISVM) are much simple but more effective classifiers than traditional support vector machines(SVMs),for dealing with large volume data.Nevertheless,the computational efficiency of the ISVM for high dimensional data is still unsatisfactory,mainly because that it requires explicit matrix inversion for updating model parameter.In this paper,we propose an incremental solution which relies on least squares to get identical prediction accuracy to that of ISVM,but is more efficient for high dimensional data.More specifically,we solve incremental least squares problem by identically transforming the matrix inversion into simple division operation,and obtain simple formulas of model updating.Experimental results on synthetic and real-world(image and biological data) confirm that the proposed incremental classifier obtains the same prediction accuracy as that of the ISVM,moreover,the proposed method performs much better than ISVM for high dimensional data.