Weighted Lagrange Ε-Twin Support Vector Regression
Ya-Fen Ye,Lan Bai,Xiang-Yu Hua,Yuan-Hai Shao,Zhen Wang,Nai-Yang Deng
DOI: https://doi.org/10.1016/j.neucom.2016.01.038
IF: 6
2016-01-01
Neurocomputing
Abstract:In this paper, an efficient weighted Lagrangian ε-twin support vector regression with quadratic loss functions (WL-ε-TSVR) has been proposed. In our WL-ε-TSVR, to reduce the impact of outliers, the weight matrix is introduced to give different penalties for the samples located in different places. Further, by using the quadratic loss functions, we just need to solve the unconstrained minimization problems (UMPs) with differentiable convex objective functions in a space of dimensionality that equals to the number of training samples. In addition, the UMPs in WL-ε-TSVR could be solved by an extremely simple linearly convergent Lagrangian algorithm. Experimental results on both three artificial data sets and nine benchmark data sets show that compared with TSVR, ε-TSVR, ULTSVR, WSVR, and WTSVR, our WL-ε-TSVR achieves better generalization performance with comparable training time, and therefore confirm the superiority of our method.