Abstract:As a novel learning algorithm for feedforward neural networks, the twin extreme learning machine (TELM) boasts advantages such as simple structure, few parameters, low complexity, and excellent generalization performance. However, it employs the squared L2-norm metric and an unbounded hinge loss function, which tends to overstate the influence of outliers and subsequently diminishes the robustness of the model. To address this issue, scholars have proposed the bounded capped L2,p-norm metric, which can be flexibly adjusted by varying the p value to adapt to different data and reduce the impact of noise. Therefore, we substitute the metric in the TELM with the capped L2,p-norm metric in this paper. Furthermore, we propose a bounded, smooth, symmetric, and noise-insensitive squared fractional loss (SF-loss) function to replace the hinge loss function in the TELM. Additionally, the TELM neglects statistical information in the data; thus, we incorporate the Fisher regularization term into our model to fully exploit the statistical characteristics of the data. Drawing upon these merits, a squared fractional loss-based robust supervised twin extreme learning machine (SF-RSTELM) model is proposed by integrating the capped L2,p-norm metric, SF-loss, and Fisher regularization term. The model shows significant effectiveness in decreasing the impacts of noise and outliers. However, the proposed model's non-convexity poses a formidable challenge in the realm of optimization. We use an efficient iterative algorithm to solve it based on the concave-convex procedure (CCCP) algorithm and demonstrate the convergence of the proposed algorithm. Finally, to verify the algorithm's effectiveness, we conduct experiments on artificial datasets, UCI datasets, image datasets, and NDC large datasets. The experimental results show that our model is able to achieve higher ACC and F1 scores across most datasets, with improvements ranging from 0.28% to 4.5% compared to other state-of-the-art algorithms.

Robust Twin Support Vector Regression with Smooth Truncated Hε Loss Function

Robust Estimation and Shrinkage in Ultrahigh Dimensional Expectile Regression with Heavy Tails and Variance Heterogeneity

A Novel Robust Smooth Support Vector Machine

Flatheaded support vector machine for regression

On Regularization Based Twin Support Vector Regression with Huber Loss

Robust twin support vector regression based on Huber loss function

CTSVM: A robust twin support vector machine with correntropy-induced loss function for binary classification problems

Symmetric LINEX loss twin support vector machine for robust classification and its fast iterative algorithm

Robust Twin Extreme Learning Machine Based on Soft Truncated Capped L1-Norm Loss Function

Robust Support Vector Data Description with Truncated Loss Function for Outliers Depression

Twin K -class support vector classification with pinball loss

GL-TSVM: A robust and smooth twin support vector machine with guardian loss function

Learning with smooth Hinge losses

Homotopy continuation approaches for robust SV classification and regression

HawkEye: Advancing Robust Regression with Bounded, Smooth, and Insensitive Loss Function

Robust Regularized Kernel Regression.

The Robust Supervised Learning Framework: Harmonious Integration of Twin Extreme Learning Machine, Squared Fractional Loss, Capped L2,p-norm Metric, and Fisher Regularization

Twin support vector quantile regression

Outlier-Robust Neural Network Training: Efficient Optimization of Transformed Trimmed Loss with Variation Regularization

A robust adaptive linear regression method for severe noise

Uncertainty-aware twin support vector machines