Union Nonparallel Support Vector Machines Framework with Consistency.

Chun-Na Li,Yuan-Hai Shao,Huajun Wang,Ling-Wei Huang,Yu-Ting Zhao,Naihua Xiu,Nai-Yang Deng
DOI: https://doi.org/10.1016/j.asoc.2023.110129
IF: 8.7
2023-01-01
Applied Soft Computing
Abstract:Though there are several dozens of nonparallel support vector machines (NSVMs), little studies on general forms and characteristics of NSVMs are investigated. To fill in this gap, this paper categorizes the existing NSVMs into two types and reveals the advantages and defects of different types of them. In particular, inconsistency problems for these models are pointed out and discussed. Based on this observation, this paper further proposes and investigates a novel max–min distance-based nonparallel support vector machine (NSVM) with desired consistency. Compared with the existing methods, the proposed NSVM has the consistency of training and test and the consistency of metric. In addition, NSVM also assigns each sample an ascertained loss, which not only is able to identify if a data sample being classified correctly, but also makes NSVM completely in line with its decision rule. NSVM can be easily extended to its nonlinear version, and both of them are effectively solved through a modified proximal difference-of-convex algorithm with extrapolation algorithm. Experimental results on the artificial dataset, benchmark datasets and a real-world dataset support the advantages of the proposed model.
What problem does this paper attempt to address?