Abstract:A family of norm-based least squares support vector machines (LSSVMs) is the effective statistical learning tool and has attracted considerable attentions. However, there are two critical problems: (1) LSSVM is ill-conditioned or singular when the sample size is much less than feature number and thus causes over-fitting for small sample size (SSS) problem, while other norm-based LSSVMs own slower training speed and cannot deal with large scale data. (2) Norm-based LSSVMs pay less attention to the edge points that are important for learning the final classifier. To overcome the above drawbacks, by replacing $$ L_{2}\text{-}norm $$ with $$ L_{\infty }\text{-}norm $$ in empirical loss, we construct a robust classifier, named $$ L_{\infty }\text{-}LSSVM $$ in short. After adjustment, $$ L_{\infty }\text{-}LSSVM $$ can detect edge points effectively and enhances the capability of the robustness and the generalization. Also, inspired by the idea of sequential minimal optimization (SMO), we design a novel SMO-typed iterative algorithm. The new algorithm not only guarantees the convergence of optimum solution in theory, but also owns the lower computational time and storage space when data size is large. Finally, extensive numerical experiments validate the above opinions again on four groups of artificial data, Non-i.i.d data: fault detection of railway turnout, four SSS datasets, two types of massive datasets and six benchmark datasets.

Least Squares Support Vector Machine Regression Based on Sparse Samples and Mixture Kernel Learning.

Sparse Representation Based on Projection Method in Online Least Squares Support Vector Machines

Efficient Sparse Least Squares Support Vector Machines for Regression

Sparse Least Squares Support Vector Machine for Function Estimation

Least Squares Support Vector Machine with Self-Organizing Multiple Kernel Learning and Sparsity.

Sparse multiple kernel for least square support vector regression

M-estimator Based Support Vector Machine and Its Application

Sparse Least Squares Support Vector Machine and Its Applications

A New Sparse LSSVM Method Based the Revised LARS

Sparse Least Squares Support Vector Machines Based on Meanshift Clustering Method

Sparse Least Squares Low Rank Kernel Machines

Modeling method of least squares support vector regression based on vector base learning

Fast Sparse Approximation for Least Squares Support Vector Machine.

More Efficient Sparse Multi-kernel Based Least Square Support Vector Machine

Sparse Lq-norm Least Squares Support Vector Machine with Feature Selection

Robust Least Squares Support Vector Machines with Applications to Soft-Sensing

Sparse Least Absolute Deviation Support Vector Machine

Sparse Algorithm for Robust LSSVM in Primal Space

Robust Least Squares Projection Twin Support Vector Machine and Its Sparse Solution

An Improved LSSVM Regression Algorithm

A Robust Least Squares Support Vector Machine Based on L∞-norm