Abstract:The K-nearest neighbor-weighted multi-class twin support vector machine (KWMTSVM) is an effective multi-classification algorithm which utilizes the local information of all training samples. However, it is easily affected by the noises and outliers owing to the use of the hinge loss function. That is because the outlier will obtain a huge loss and become the support vector, which will shift the separating hyperplane inappropriately. To reduce the negative influence of outliers, we use the ramp loss function to replace the hinge loss function in KWMTSVM and propose a novel sparse and robust multi-classification algorithm named ramp loss K-nearest neighbor-weighted multi-class twin support vector machine (RKWMTSVM) in this paper. Firstly, the proposed RKWMTSVM restricts the loss of outlier to a fixed value, thus the negative influence on the construction of hyperplane is suppressed and the classification performance is further improved. Secondly, since outliers will not become support vectors, the RKWMTSVM is a sparser algorithm, especially compared with KWMTSVM. Thirdly, because RKWMTSVM is a non-differentiable non-convex optimization problem, we use the concave–convex procedure (CCCP) to solve it. In each iteration of CCCP, the proposed RKWMTSVM solves a series of KWMTSVM-like problems. That also means RKWMTSVM inherits the merits of KWMTSVM, namely, it can exploit the local information of intra-class to improve the generalization ability and use inter-class information to remove the redundant constraints and accelerate the solution process. In the end, the clipping dual coordinate descent (clipDCD) algorithm is employed into our RKWMTSVM to further speed up the computational speed. We do numerical experiments on twenty-four benchmark datasets. The experimental results verify the validity and effectiveness of our algorithm.

Ramp Loss Based Robust One-Class SVM

Robust One-Class SVM for Fault Detection

Robust least squares one-class support vector machine

Training Robust Support Vector Machine with Smooth Ramp Loss in the Primal Space

A Fast Training Method for OC-SVM Based on the Random Sampling Lemma

Ramp Loss Linear Programming Support Vector Machine.

Ramp Loss KNN-weighted Multi-Class Twin Support Vector Machine

Robust support vector machine training via convex outlier ablation

Multikernel Correntropy Based Robust Least Squares One-Class Support Vector Machine

A robust SVM-based approach with feature selection and outliers detection for classification problems

Coordinate Descent Algorithm for Ramp Loss Linear Programming Support Vector Machines

Robust multiclass least squares support vector classifier with optimal error distribution

Robust Capped lp-Norm Support Vector Ordinal Regression

Multiclass Capped &Amp;#8467;p-Norm SVM for Robust Classifications

Multiclass Capped ℓp-Norm SVM for Robust Classifications.

A two-stage safe screening method for non-convex support vector machine with ramp loss

A Non-Convex Robust Small Sphere and Large Margin Support Vector Machine for Imbalanced Data Classification

A Weighted One-Class Support Vector Machine

Robust Support Vector Regression with Generalized Loss Function and Applications

Data-Driven Anomaly Detection Using OCSVM with Boundary Optimzation

One-Class Slab Support Vector Machine