Abstract:<p>Robust least squares support vector regression (RLSSVR), minimizing the variance and mean of the global modeling errors, has achieved the excellent performance in dealing with outliers. However, generalizing the RLSSVR for solving the binary classification problems is easily misguided by the outliers because the differences in the modeling errors of the different classes are not considered. To address this issue, a robust least squares support vector classifier (RLSSVC) with optimal error distribution is proposed. RLSSVC minimizes the mean and variance of the modeling errors class-wisely, and considers the difference in the modeling errors of the different classes. Specifically, the binary classification problems are considered at first, the variance analysis indicates that the variance of the modeling errors of RLSSVC is smaller than that of RLSSVR. According to the validity in solving the binary classification problems, RLSSVC is naturally generalized for solving the multiclass classification problems by introducing multiple error adjusting factors. The robustness analysis provides a theoretical guarantee for the robustness of RLSSVC, which delivers that RLSSVC assigns the smaller weights for the training instances with the larger errors, while the larger weights for the training instances with the smaller errors. Furthermore, our optimization objective function is strictly convex and thus can obtain their corresponding closed-form solutions, resulting in higher computational performance. Finally, the performance of RLSSVC is further improved by introducing the metric learning and kernel trick. Theoretical and experimental results indicate that the proposed RLSSVC achieves the better classification effect with the lower computational costs.</p>

The Superiority of Bayes Linear Unbiased Minimum Variance Estimator with Respect to Ridge Estimator

The Superiority of the Bayes Linear Unbiased Minimum Variance Estimator under Balanced Loss Function

Small-sample Properties for Generalized Ridge Estimator of Regression Coefficients in Linear Regression Model

M-estimator Based Support Vector Machine and Its Application

Identifying a class of Ridge-type estimators in binary logistic regression models

The Optimal Property of Almost Unbiased Stein Ridge Type Principal Component Estimator Under Mean Square Error

Bayes estimator for the inequality-constrained regression model*

Modified ridge estimator in the Bell regression model

On a Biased Prediction Based on Optimal Mean Square Error Criterion

On the Liu estimation of Bell regression model in the presence of multicollinearity

Prediction Risk and Estimation Risk of the Ridgeless Least Squares Estimator under General Assumptions on Regression Errors

Equality between two general ridge estimators and equivalence of their residual sums of squares

Bayes beats Cross Validation: Efficient and Accurate Ridge Regression via Expectation Maximization

Broad Minimax Probability Learning System and its Application in Regression Modeling

New ridge parameter estimators for the quasi-Poisson ridge regression model

A Monte Carlo Method for Variance Estimation for Estimators Based on Induced Smoothing.

A new ridge type estimator and its performance for the linear regression model: Simulation and application

Robust multiclass least squares support vector classifier with optimal error distribution

Unbiased MLMC-based Variational Bayes for Likelihood-Free Inference

New ridge parameter estimators for the zero-inflated Conway Maxwell Poisson ridge regression model

Ridge Regression for Paired Comparisons: A Tractable New Approach, with Application to Premier League Football