Abstract:<p>Robust least squares support vector regression (RLSSVR), minimizing the variance and mean of the global modeling errors, has achieved the excellent performance in dealing with outliers. However, generalizing the RLSSVR for solving the binary classification problems is easily misguided by the outliers because the differences in the modeling errors of the different classes are not considered. To address this issue, a robust least squares support vector classifier (RLSSVC) with optimal error distribution is proposed. RLSSVC minimizes the mean and variance of the modeling errors class-wisely, and considers the difference in the modeling errors of the different classes. Specifically, the binary classification problems are considered at first, the variance analysis indicates that the variance of the modeling errors of RLSSVC is smaller than that of RLSSVR. According to the validity in solving the binary classification problems, RLSSVC is naturally generalized for solving the multiclass classification problems by introducing multiple error adjusting factors. The robustness analysis provides a theoretical guarantee for the robustness of RLSSVC, which delivers that RLSSVC assigns the smaller weights for the training instances with the larger errors, while the larger weights for the training instances with the smaller errors. Furthermore, our optimization objective function is strictly convex and thus can obtain their corresponding closed-form solutions, resulting in higher computational performance. Finally, the performance of RLSSVC is further improved by introducing the metric learning and kernel trick. Theoretical and experimental results indicate that the proposed RLSSVC achieves the better classification effect with the lower computational costs.</p>

Adjustable entropy funtion method for misclassification minimization problems

A Novel Svm Modeling Approach For Highly Imbalanced And Overlapping Classification

M-estimator Based Support Vector Machine and Its Application

Hybrid SVM algorithm oriented to classifying imbalanced datasets

Probabilistic Safety Regions Via Finite Families of Scalable Classifiers

Cost Sensitive Support Vector Machines

Stochastic Variance-Reduced Majorization-Minimization Algorithms

Logistic Regression with Misclassification in Binary Outcome Variables: a Method and Software

A Novel Robust Smooth Support Vector Machine

Robust multiclass least squares support vector classifier with optimal error distribution

Robust Support Vector Machine Using Least Median Loss Penalty

The Entropy Enigma: Success and Failure of Entropy Minimization

A Novel Loss Function-based Support Vector Machine for Binary Classification

An Mpec Estimator for Misclassification Models

Instance-dependent misclassification cost-sensitive learning for default prediction

Analysis of Classification Margin for Classification Accuracy with Applications

The cross entropy method for classification

An alternative to SVM Method for Data Classification

Nonlinear Online Classification Algorithm with Probability Margin

On the KL-Divergence-based Robust Satisficing Model

Restricted Minimum Error Entropy Criterion for Robust Classification