Abstract:Twin support vector regression (TSVR) is generally employed with \( \varepsilon \)-insensitive loss function which is not well capable to handle the noises and outliers. According to the definition, Huber loss function performs as quadratic for small errors and linear for others and shows better performance in comparison to Gaussian loss hence it restrains easily for a different type of noises and outliers. Recently, TSVR with Huber loss (HN-TSVR) has been suggested to handle the noise and outliers. Like TSVR, it is also having the singularity problem which degrades the performance of the model. In this paper, regularized version of HN-TSVR is proposed as regularization based twin support vector regression (RHN-TSVR) to avoid the singularity problem of HN-TSVR by applying the structured risk minimization principle that leads to our model convex and well-posed. This proposed RHN-TSVR model is well capable to handle the noise as well as outliers and avoids the singularity issue. To show the validity and applicability of proposed RHN-TSVR, various experiments perform on several artificial generated datasets having uniform, Gaussian and Laplacian noise as well as on benchmark different real-world datasets and compare with support vector regression, TSVR, \( \varepsilon \)-asymmetric Huber SVR, \( \varepsilon \)-support vector quantile regression and HN-TSVR. Here, all benchmark real-world datasets are embedded with a different significant level of noise 0%, 5% and 10% on different reported algorithms with the proposed approach. The proposed algorithm RHN-TSVR is showing better prediction ability on artificial datasets as well as real-world datasets with a different significant level of noise compared to other reported models.

An Epsilon Hierarchical Fuzzy Twin Support Vector Regression

Fuzzy Time Series Analysis Method Based on Least Squares Support Vector Machines

Fuzzy Support Vector Regression Based on Data Domain Description

Flatheaded support vector machine for regression

Incremental and decremental fuzzy bounded twin support vector machine

Multi-hyperplane twin support vector regression guided with fuzzy clustering

Robust Twin Support Vector Regression with Smooth Truncated Hε Loss Function

On Regularization Based Twin Support Vector Regression with Huber Loss

Fuzzy Support Vector Machine For Regression Estimation

Improved 2-norm Based Fuzzy Least Squares Twin Support Vector Machine

A novel fuzzy twin support vector machine based on centered kernel alignment

Fuzzy Least Squares Twin Support Vector Machines

Fuzzy support vector clustering

A Study of Modelling Non-Stationary Time Series Using Support Vector Machines with Fuzzy Segmentation Information

Twin support vector quantile regression

Jointly evolving and compressing fuzzy system for feature reduction and classification

Uncertainty-aware twin support vector machines

Intuitionistic Fuzzy Weighted Least Squares Twin SVMs

Fuzzy regular least squares twin support vector machine and its application in fault diagnosis

Enhanced Feature Based Granular Ball Twin Support Vector Machine

Financial time series forecasting using twin support vector regression