Abstract:The K-nearest neighbor-weighted multi-class twin support vector machine (KWMTSVM) is an effective multi-classification algorithm which utilizes the local information of all training samples. However, it is easily affected by the noises and outliers owing to the use of the hinge loss function. That is because the outlier will obtain a huge loss and become the support vector, which will shift the separating hyperplane inappropriately. To reduce the negative influence of outliers, we use the ramp loss function to replace the hinge loss function in KWMTSVM and propose a novel sparse and robust multi-classification algorithm named ramp loss K-nearest neighbor-weighted multi-class twin support vector machine (RKWMTSVM) in this paper. Firstly, the proposed RKWMTSVM restricts the loss of outlier to a fixed value, thus the negative influence on the construction of hyperplane is suppressed and the classification performance is further improved. Secondly, since outliers will not become support vectors, the RKWMTSVM is a sparser algorithm, especially compared with KWMTSVM. Thirdly, because RKWMTSVM is a non-differentiable non-convex optimization problem, we use the concave–convex procedure (CCCP) to solve it. In each iteration of CCCP, the proposed RKWMTSVM solves a series of KWMTSVM-like problems. That also means RKWMTSVM inherits the merits of KWMTSVM, namely, it can exploit the local information of intra-class to improve the generalization ability and use inter-class information to remove the redundant constraints and accelerate the solution process. In the end, the clipping dual coordinate descent (clipDCD) algorithm is employed into our RKWMTSVM to further speed up the computational speed. We do numerical experiments on twenty-four benchmark datasets. The experimental results verify the validity and effectiveness of our algorithm.

Multikernel Correntropy Based Robust Least Squares One-Class Support Vector Machine

Robust least squares one-class support vector machine

A Multi-Class Large Margin Classifier

Robust multiclass least squares support vector classifier with optimal error distribution

Fast Incremental Learning Method for One-Class Support Vector Machine

Robust Least-Squares Support Vector Machine with Minimization of Mean and Variance of Modeling Error.

An Innovative One-Class Least Squares Support Vector Machine Model Based on Continuous Cognition.

Robust One-Class SVM for Fault Detection

Two-stage sparse multi-kernel optimization classifier method for more accurate and explainable prediction

Wasserstein Distributionally Robust Multiclass Support Vector Machine

Recursive Robust Least Squares Support Vector Regression Based on Maximum Correntropy Criterion

Ramp Loss Based Robust One-Class SVM

Asymmetric and robust loss function driven least squares support vector machine

Robust One-Class Classification with Support Vector Data Description and Mixed Exponential Loss Function

Multiview Learning With Robust Double-Sided Twin SVM

Multi-Kernel Correntropy for Robust Learning

Robust Proximal Support Vector Regression Based on Maximum Correntropy Criterion

CappedL1-norm Distance Metric-Based Fast Robust Twin Bounded Support Vector Machine

Ramp Loss KNN-weighted Multi-Class Twin Support Vector Machine

Maximum Correntropy Criterion-Based Hierarchical One-Class Classification

CTSVM: A robust twin support vector machine with correntropy-induced loss function for binary classification problems