Abstract:The K-nearest neighbor-weighted multi-class twin support vector machine (KWMTSVM) is an effective multi-classification algorithm which utilizes the local information of all training samples. However, it is easily affected by the noises and outliers owing to the use of the hinge loss function. That is because the outlier will obtain a huge loss and become the support vector, which will shift the separating hyperplane inappropriately. To reduce the negative influence of outliers, we use the ramp loss function to replace the hinge loss function in KWMTSVM and propose a novel sparse and robust multi-classification algorithm named ramp loss K-nearest neighbor-weighted multi-class twin support vector machine (RKWMTSVM) in this paper. Firstly, the proposed RKWMTSVM restricts the loss of outlier to a fixed value, thus the negative influence on the construction of hyperplane is suppressed and the classification performance is further improved. Secondly, since outliers will not become support vectors, the RKWMTSVM is a sparser algorithm, especially compared with KWMTSVM. Thirdly, because RKWMTSVM is a non-differentiable non-convex optimization problem, we use the concave–convex procedure (CCCP) to solve it. In each iteration of CCCP, the proposed RKWMTSVM solves a series of KWMTSVM-like problems. That also means RKWMTSVM inherits the merits of KWMTSVM, namely, it can exploit the local information of intra-class to improve the generalization ability and use inter-class information to remove the redundant constraints and accelerate the solution process. In the end, the clipping dual coordinate descent (clipDCD) algorithm is employed into our RKWMTSVM to further speed up the computational speed. We do numerical experiments on twenty-four benchmark datasets. The experimental results verify the validity and effectiveness of our algorithm.

Multiclass Capped &Amp;#8467;p-Norm SVM for Robust Classifications

Multiclass Capped ℓp-Norm SVM for Robust Classifications.

A Novel Svm Modeling Approach For Highly Imbalanced And Overlapping Classification

A Multi-Class Large Margin Classifier

Robust Capped lp-Norm Support Vector Ordinal Regression

Multi-Class L2,1-Norm Support Vector Machine

CappedL1-norm Distance Metric-Based Fast Robust Twin Bounded Support Vector Machine

Multi-class Support Vector Machine with Maximizing Minimum Margin

$p$SVM: Soft-margin SVMs with $p$-norm Hinge Loss

Multi-Class Support Vector Machine Via Maximizing Multi-Class Margins

Capped Asymmetric Elastic Net Support Vector Machine for Robust Binary Classification

Class-attribute Priors: Adapting Optimization to Heterogeneity and Fairness Objective

Ramp Loss KNN-weighted Multi-Class Twin Support Vector Machine

Ramp Loss Based Robust One-Class SVM

L2-Loss nonparallel bounded support vector machine for robust classification and its DCD-type solver

Fused Robust Geometric Nonparallel Hyperplane Support Vector Machine for Pattern Classification

Support Vector Machine Classifier with Pinball Loss

Within-class Penalty Based Multi-Class Support Vector Machine.

Robust Twin Extreme Learning Machine Based on Soft Truncated Capped L1-Norm Loss Function

Large-Scale Robust Semisupervised Classification

Robust Feature Selection Via Simultaneous Capped ℓ2-Norm and ℓ2,1-Norm Minimization