Abstract:<p>Robust least squares support vector regression (RLSSVR), minimizing the variance and mean of the global modeling errors, has achieved the excellent performance in dealing with outliers. However, generalizing the RLSSVR for solving the binary classification problems is easily misguided by the outliers because the differences in the modeling errors of the different classes are not considered. To address this issue, a robust least squares support vector classifier (RLSSVC) with optimal error distribution is proposed. RLSSVC minimizes the mean and variance of the modeling errors class-wisely, and considers the difference in the modeling errors of the different classes. Specifically, the binary classification problems are considered at first, the variance analysis indicates that the variance of the modeling errors of RLSSVC is smaller than that of RLSSVR. According to the validity in solving the binary classification problems, RLSSVC is naturally generalized for solving the multiclass classification problems by introducing multiple error adjusting factors. The robustness analysis provides a theoretical guarantee for the robustness of RLSSVC, which delivers that RLSSVC assigns the smaller weights for the training instances with the larger errors, while the larger weights for the training instances with the smaller errors. Furthermore, our optimization objective function is strictly convex and thus can obtain their corresponding closed-form solutions, resulting in higher computational performance. Finally, the performance of RLSSVC is further improved by introducing the metric learning and kernel trick. Theoretical and experimental results indicate that the proposed RLSSVC achieves the better classification effect with the lower computational costs.</p>

Robust Sparse Least Squares Support Vector Regression Machine Based on Decremental Learning

A Novel Robust Smooth Support Vector Machine

Recursive Least Squares Support Vector Regression

Flatheaded support vector machine for regression

Iterative robust least square support vector machine for spectral analysis

L1-Norm Least Squares Support Vector Regression Via the Alternating Direction Method of Multipliers

Nonlinear Robust Modeling Base on Least Trimmed Squares Regression

One Kind of Reduced Learning Algorithm for Support Vector Domain Description

Sparse Least Absolute Deviation Support Vector Machine

M-estimator Based Support Vector Machine and Its Application

Robust Iterative Algorithm of Weighted Least Squares Support Vector Machine and Its Application in Spectral Analysis

An Incremental Learning Algorithm Based on Support Vector Domain Classifier

Asymmetric and robust loss function driven least squares support vector machine

Sparse Least Squares Support Vector Machine for Function Estimation

Recursive Reduced Least Squares Support Vector Regression

Modeling and Prediction Based on Recursive Least Square Support Vector Regression

Modeling method of least squares support vector regression based on vector base learning

Robust multiclass least squares support vector classifier with optimal error distribution

Robust Recursive Kernel Learning Modeling Method with Application to Blast Furnace

Improving Sparsity and Scalability in Regularized Nonconvex Truncated-Loss Learning Problems

A Novel Support Vector Regression Algorithm Incorporated with Prior Knowledge and Error Compensation for Small Datasets