Abstract:Twin support vector regression (TSVR) is generally employed with \( \varepsilon \)-insensitive loss function which is not well capable to handle the noises and outliers. According to the definition, Huber loss function performs as quadratic for small errors and linear for others and shows better performance in comparison to Gaussian loss hence it restrains easily for a different type of noises and outliers. Recently, TSVR with Huber loss (HN-TSVR) has been suggested to handle the noise and outliers. Like TSVR, it is also having the singularity problem which degrades the performance of the model. In this paper, regularized version of HN-TSVR is proposed as regularization based twin support vector regression (RHN-TSVR) to avoid the singularity problem of HN-TSVR by applying the structured risk minimization principle that leads to our model convex and well-posed. This proposed RHN-TSVR model is well capable to handle the noise as well as outliers and avoids the singularity issue. To show the validity and applicability of proposed RHN-TSVR, various experiments perform on several artificial generated datasets having uniform, Gaussian and Laplacian noise as well as on benchmark different real-world datasets and compare with support vector regression, TSVR, \( \varepsilon \)-asymmetric Huber SVR, \( \varepsilon \)-support vector quantile regression and HN-TSVR. Here, all benchmark real-world datasets are embedded with a different significant level of noise 0%, 5% and 10% on different reported algorithms with the proposed approach. The proposed algorithm RHN-TSVR is showing better prediction ability on artificial datasets as well as real-world datasets with a different significant level of noise compared to other reported models.

A regularization for the projection twin support vector machine

Sparse Representation Based on Projection Method in Online Least Squares Support Vector Machines

Flatheaded support vector machine for regression

M-estimator Based Support Vector Machine and Its Application

Adaptive Regularization for Transductive Support Vector Machine.

On Regularization Based Twin Support Vector Regression with Huber Loss

CTSVM: A robust twin support vector machine with correntropy-induced loss function for binary classification problems

New method for solving Ivanov regularization-based support vector machine learning

Twin SVM for conditional probability estimation in binary and multiclass classification

Modified Truncated Randomized Singular Value Decomposition (MTRSVD) Algorithms for Large Scale Discrete Ill-Posed Problems with General-Form Regularization

Universal Consistency of Twin Support Vector Machines.

Uncertainty-aware twin support vector machines

Weighted Twin Support Vector Machines with Local Information and Its Application.

Symmetric LINEX loss twin support vector machine for robust classification and its fast iterative algorithm

Multiview learning with twin parametric margin SVM

A Feature Selection Method for Nonparallel Plane Support Vector Machine Classification

Comprehensive Review On Twin Support Vector Machines

An Effective Multiclass Twin Hypersphere Support Vector Machine and Its Practical Engineering Applications

Primal dual algorithm for solving the nonsmooth Twin SVM

Robust Twin Parametric Margin Support Vector Machine for Multiclass Classification

GL-TSVM: A robust and smooth twin support vector machine with guardian loss function