Abstract:<p>Robust least squares support vector regression (RLSSVR), minimizing the variance and mean of the global modeling errors, has achieved the excellent performance in dealing with outliers. However, generalizing the RLSSVR for solving the binary classification problems is easily misguided by the outliers because the differences in the modeling errors of the different classes are not considered. To address this issue, a robust least squares support vector classifier (RLSSVC) with optimal error distribution is proposed. RLSSVC minimizes the mean and variance of the modeling errors class-wisely, and considers the difference in the modeling errors of the different classes. Specifically, the binary classification problems are considered at first, the variance analysis indicates that the variance of the modeling errors of RLSSVC is smaller than that of RLSSVR. According to the validity in solving the binary classification problems, RLSSVC is naturally generalized for solving the multiclass classification problems by introducing multiple error adjusting factors. The robustness analysis provides a theoretical guarantee for the robustness of RLSSVC, which delivers that RLSSVC assigns the smaller weights for the training instances with the larger errors, while the larger weights for the training instances with the smaller errors. Furthermore, our optimization objective function is strictly convex and thus can obtain their corresponding closed-form solutions, resulting in higher computational performance. Finally, the performance of RLSSVC is further improved by introducing the metric learning and kernel trick. Theoretical and experimental results indicate that the proposed RLSSVC achieves the better classification effect with the lower computational costs.</p>

Efficient Nonlinear Classification Via Low-Rank Regularised Least Squares.

On low-rank regularized least squares for scalable nonlinear classification

Efficient and provable online reduced rank regression via online gradient descent

Low-rank kernel regression with preserved locality for multi-class analysis

Regularized Linear Discriminant Analysis Using a Nonlinear Covariance Matrix Estimator

Denoising Low-Rank Discrimination based Least Squares Regression for image classification

Electronic structure study by means of X-ray spectroscopy and theoretical calculations of the "ferric star" single molecule magnet

Mini-batch Quasi-Newton Optimization for Large Scale Linear Support Vector Regression

Robust multiclass least squares support vector classifier with optimal error distribution

Constrained Low-Rank Learning Using Least Squares-Based Regularization

Robust Regularized Low-Rank Matrix Models for Regression and Classification

An Efficient Kernel-Based Nonlinear Regression Method For Two-Class Classification

Active Learning Support Vector Machines with Low-Rank Transformation

Laplacian Regularized Non-negative Sparse Low-Rank Representation Classification.

Low-rank discriminative least squares regression for image classification

Nonconvex Optimization Meets Low-Rank Matrix Factorization: An Overview

Fast Low-Rank Matrix Learning with Nonconvex Regularization

Learning with Selected Features

A Naïve Bayes Regularized Logistic Regression Estimator for Low-dimensional Classification

Robust RLS Via the Nonconvex Sparsity Prompting Penalties of Outlier Components.