Abstract:Twin support vector regression (TSVR) is generally employed with \( \varepsilon \)-insensitive loss function which is not well capable to handle the noises and outliers. According to the definition, Huber loss function performs as quadratic for small errors and linear for others and shows better performance in comparison to Gaussian loss hence it restrains easily for a different type of noises and outliers. Recently, TSVR with Huber loss (HN-TSVR) has been suggested to handle the noise and outliers. Like TSVR, it is also having the singularity problem which degrades the performance of the model. In this paper, regularized version of HN-TSVR is proposed as regularization based twin support vector regression (RHN-TSVR) to avoid the singularity problem of HN-TSVR by applying the structured risk minimization principle that leads to our model convex and well-posed. This proposed RHN-TSVR model is well capable to handle the noise as well as outliers and avoids the singularity issue. To show the validity and applicability of proposed RHN-TSVR, various experiments perform on several artificial generated datasets having uniform, Gaussian and Laplacian noise as well as on benchmark different real-world datasets and compare with support vector regression, TSVR, \( \varepsilon \)-asymmetric Huber SVR, \( \varepsilon \)-support vector quantile regression and HN-TSVR. Here, all benchmark real-world datasets are embedded with a different significant level of noise 0%, 5% and 10% on different reported algorithms with the proposed approach. The proposed algorithm RHN-TSVR is showing better prediction ability on artificial datasets as well as real-world datasets with a different significant level of noise compared to other reported models.

Robust Support Vector Regression in Primal with Asymmetric Huber Loss

Robust twin support vector regression based on Huber loss function

A Novel Robust Smooth Support Vector Machine

Robust Estimation and Shrinkage in Ultrahigh Dimensional Expectile Regression with Heavy Tails and Variance Heterogeneity

Robust Regularized Kernel Regression.

On Regularization Based Twin Support Vector Regression with Huber Loss

Robust Support Vector Regression in the Primal

Robust Support Vector Data Description with Truncated Loss Function for Outliers Depression

Robust support vector machine training via convex outlier ablation

Huber Loss Meets Spatial Autoregressive Model: A Robust Variable Selection Method with Prior Information

On the intrinsic robustness to noise of some leading classifiers and symmetric loss function -- an empirical evaluation

Universal Robust Regression via Maximum Mean Discrepancy

Robust Support Vector Machine Using Least Median Loss Penalty

Functional Adaptive Huber Linear Regression

Generalized robust loss functions for machine learning

Efficient Low-Rank Semidefinite Programming With Robust Loss Functions

A Robust Optimization Model for Nonlinear Support Vector Machine

Robust Twin Support Vector Regression with Smooth Truncated Hε Loss Function

A Robust Learning Approach for Regression Models Based on Distributionally Robust Optimization.

Robust Regression via Mutivariate Regression Depth

A Robust Learning Algorithm for Regression Models Using Distributionally Robust Optimization under the Wasserstein Metric