Abstract:Ordinal regression is a specialized supervised problem where the labels show an inherent order. The order distinguishes it from normal multi-class problem. Support Vector Ordinal Regression, as an outstanding ordinal regression model, is widely used in many ordinal regression tasks. However, like most supervised learning algorithms, the design of SVOR is based on the assumption that the training data are real and reliable, which is difficult to satisfy in real-world data. In many practical applications, outliers are frequently present in the training set, potentially leading to misguide the learning process, such that the performance is non-optimal. In this paper, we propose a novel capped $\ell_{p}$-norm loss function that is theoretically robust to both light and heavy outliers. The capped $\ell_{p}$-norm loss can help the model detect and eliminate outliers during training process. Adhering to this concept, we introduce a new model, Capped $\ell_{p}$-Norm Support Vector Ordinal Regression(CSVOR), that is robust to outliers. CSVOR uses a weight matrix to detect and eliminate outliers during the training process to improve the robustness to outliers. Moreover, a Re-Weighted algorithm algorithm which is illustrated convergence by our theoretical results is proposed to effectively minimize the corresponding problem. Extensive experimental results demonstrate that our model outperforms state-of-the-art(SOTA) methods, particularly in the presence of outliers.

Capped Asymmetric Elastic Net Support Vector Machine for Robust Binary Classification

A Novel Robust Smooth Support Vector Machine

Fused Robust Geometric Nonparallel Hyperplane Support Vector Machine for Pattern Classification

Flatheaded support vector machine for regression

Multiclass Capped &Amp;#8467;p-Norm SVM for Robust Classifications

A Safe Double Screening Strategy for Elastic Net Support Vector Machine

CappedL1-norm Distance Metric-Based Fast Robust Twin Bounded Support Vector Machine

Multiclass Capped ℓp-Norm SVM for Robust Classifications.

CTSVM: A robust twin support vector machine with correntropy-induced loss function for binary classification problems

Elastic Net Nonparallel Hyperplane Support Vector Machine and Its Geometrical Rationality

Robust Support Vector Regression with Generalized Loss Function and Applications

A New Adaptive Weighted Imbalanced Data Classifier Via Improved Support Vector Machines with High-Dimension Nature

Robust Twin Extreme Learning Machine Based on Soft Truncated Capped L1-Norm Loss Function

L2-Loss nonparallel bounded support vector machine for robust classification and its DCD-type solver

Robust Elastic Net Regression

A Robust Loss Function for Classification with Imbalanced Datasets.

Smooth pinball loss nonparallel support vector machine for robust classification

Robust Capped lp-Norm Support Vector Ordinal Regression

Training Robust Support Vector Regression with Smooth Non-Convex Loss Function

Asymmetric Support Vector Machine For The Classification Problem With Asymmetric Cost Of Misclassification

Training robust support vector regression via D. C. program