A Nonparallel Support Vector Machine with Pinball Loss for Pattern Classification

Liming Liu,Maoxiang Chu,Rongfen Gong,Xinyu Qi
DOI: https://doi.org/10.3233/jifs-191845
2020-01-01
Journal of Intelligent & Fuzzy Systems
Abstract:In this paper, we propose a nonparallel support vector machine with pinball loss (Pin-NPSVM) that deals with the noise sensitivity and resampling instability of NPSVM. More specifically, we redefine a pinball loss funtion and build a pair of quantile hyper-planes. Each quantile hyper-plane is constructed by using the new pinball loss instead of epsilon-insensitive loss, which makes the new classification model be insensitive to noise samples, especially for feature noise samples around the decision boundary. Moreover, instead of hinge loss, Pin-NPSVM also builds a pair of decision boundaries based on traditional pinball loss, which further improves the anti-nosie ability of the classification model. In a word, Pin-NPSVM not only inherits the characteristics of the nonparallel optimal hyper-planes, but also has a consistent model with Pin-SVM, which can process noise data well. Finally, numerical experimental results show that the Pin-NPSVM has more obvious advantages than other models in classification performance, especially for noise datasets.
What problem does this paper attempt to address?