Abstract:Support Vector Machines (SVMs) are among the most popular and the best performing classification algorithms. Various approaches have been proposed to reduce the high computation and memory cost when training and predicting based on large-scale datasets with kernel SVMs. A popular one is the linearization framework, which successfully builds a bridge between the $L_1$-loss kernel SVM and the $L_1$-loss linear SVM. For linear SVMs, very recently, a semismooth Newton's method is proposed. It is shown to be very competitive and have low computational cost. Consequently, a natural question is whether it is possible to develop a fast semismooth Newton's algorithm for kernel SVMs. Motivated by this question and the idea in linearization framework, in this paper, we focus on the $L_2$-loss kernel SVM and propose a semismooth Newton's method based linearization and approximation approach for it. The main idea of this approach is to first set up an equivalent linear SVM, then apply the Nyström method to approximate the kernel matrix, based on which a reduced linear SVM is obtained. Finally, the fast semismooth Newton's method is employed to solve the reduced linear SVM. We also provide some theoretical analyses on the approximation of the kernel matrix. The advantage of the proposed approach is that it maintains low computational cost and keeps a fast convergence rate. Results of extensive numerical experiments verify the efficiency of the proposed approach in terms of both predicting accuracy and speed.

Design of Semi-Tensor Product-Based Kernel Function for SVM Nonlinear Classification

A novel tree kernel support vector machine classifier for modeling the relationship between bioactivity and molecular descriptors

Using Svm To Model And Control Nonlinear Dynamical Systems

Distance-Based Classifier Via the Kernel Trick.

Svm with Quadratic Polynomial Kernel Function Based Nonlinear Model One-Step-Ahead Predictive Control

A new trigonometric kernel function for support vector machine

A nonlinear kernel SVM classifier via L 0 / 1 soft-margin loss with classification performance

SVM Compound Kernel Functions for Vehicle Target Classification

Multikernel semiparametric linear programming support vector regression

A Semismooth-Newton's-Method-Based Linearization and Approximation Approach for Kernel Support Vector Machines

Sparse Random Projection for Χ2 Kernel Linearization: Algorithm and Applications to Image Classification

SVM Classification:Its Contents and Challenges

Study on SVM based model predictive control

A support vector machine classifier based on a new kernel function model for hyperspectral data

Nonlinear Process Monitoring Using Improved Kernel Principal Component Analysis

A Study on Sigmoid Kernels for SVM and the Training of non-PSD Kernels by SMO-type Methods

Feature Expansion and Feature Selection for General Pattern Recognition Problems

Design of a Multiple Kernel Learning Algorithm for LS-SVM by Convex Programming

Linear spatial pyramid matching using sparse coding for image classification

An efficient Kernel-based matrixized least squares support vector machine

Nonlinear Pocket Algorithm with Kernels