A novel robust nonparallel support vector classifier based on one optimization problem

Kai Qi,Hu Yang
DOI: https://doi.org/10.1007/s00521-022-07814-0
2022-01-01
Abstract:The real data is often contaminated by outliers (label noises), which lead to the deviation of the final separating hyperplane and reduce the prediction accuracy. In this paper, we propose a novel robust geometric twin parametric-margin support vector machine (RGTPSVM) to tackle this issue. The method constructs classifier directly based on the average of two resulting nonparallel boundary hyperplanes, which are obtained by solving one single quadratic programming problem. We show that the boundary hyperplanes sought by RGTPSVM are less sensitive to the outliers, producing a more reasonable and robust final separating hyperplane. To further strengthen the robustness, we also design a rescaled squared hinge loss function for the model, since the hinge loss function is linear related to the margin variable and diverges to infinity. Extensive experiments are conducted to demonstrate the prediction performance of RGTPSVM. Compared with several popular SVMs, our method is stable and outperforms others in most cases.
What problem does this paper attempt to address?