Abstract:Support vector machines (SVMs) are successful modeling and prediction tools with a variety of applications. Previous work has demonstrated the superiority of the SVMs in dealing with the high dimensional, low sample size problems. However, the numerical difficulties of the SVMs will become severe with the increase of the sample size. Although there exist many solvers for the SVMs, only few of them are designed by exploiting the special structures of the SVMs. In this paper, we propose a highly efficient sparse semismooth Newton based augmented Lagrangian method for solving a large-scale convex quadratic programming problem with a linear equality constraint and a simple box constraint, which is generated from the dual problems of the SVMs. By leveraging the primal-dual error bound result, the fast local convergence rate of the augmented Lagrangian method can be guaranteed. Furthermore, by exploiting the second-order sparsity of the problem when using the semismooth Newton method,the algorithm can efficiently solve the aforementioned difficult problems. Finally, numerical comparisons demonstrate that the proposed algorithm outperforms the current state-of-the-art solvers for the large-scale SVMs.

Linear support vector machine regression models under different criteria

Novel Linear Search for Support Vector Machine Parameter Selection

New Predictive Control Algorithms Based on Least Squares Support Vector Machines

M-estimator Based Support Vector Machine and Its Application

Recursive Training Algorithm for One-Class Support Vector Machine Based on Active Set Method

Using Svm To Model And Control Nonlinear Dynamical Systems

Sparse Least Squares Support Vector Machine for Function Estimation

Mini-batch Quasi-Newton Optimization for Large Scale Linear Support Vector Regression

Least Square Generalized Support Vector Machines for Regression

Modeling method of least squares support vector regression based on vector base learning

Application of Support Vector Machines to Accelerate the Solution Speed of Metaheuristic Algorithms

On-line Support Vector Machine Training Algorithm and Its Application

Fuzzy Support Vector Machine For Regression Estimation

Improved Conjugate Gradient Implementation for Least Squares Support Vector Machines

Least Squares Support Vector Machine Algorithm

Sparse Least Absolute Deviation Support Vector Machine

A Fast Iterative Single Data Approach to Training Unconstrained Least Squares Support Vector Machines

A sparse semismooth Newton based augmented Lagrangian method for large-scale support vector machines

Support Vector Machine Algorithm in Machine Learning

A Robust Optimization Model for Nonlinear Support Vector Machine

Improving Support Vector Machine Classifiers By Modifying Kernel Functions