Abstract:Twin support vector machine (TSVM) is regarded as a milestone in the development of the powerful SVM. It finds two nonparallel planes by resolving a pair of smaller-sized quadratic programming problems rather than a single large one, which makes the learning speed of TSVM approximately four times faster than that of the standard SVM. However, the empirical risk minimization principle is implemented in the TSVM, so it easily leads to the over-fitting problem and reduces the prediction accuracy of the classifier. ν -TSVM, as a variant of TSVM, also implements the empirical risk minimization principle. To enhance the generalization ability of the classifier, we propose an improved ν -TSVM by introducing a regularization term into the objective function, so there are two parts in the objective function, one of which is to maximize the margin between the two parallel hyper-planes, and the other one is to minimize the training errors of two classes of samples. Therefore the structural risk minimization principle is implemented in our improved ν -TSVM. Numerical experiments on one artificial dataset and nine benchmark datasets show that our improved ν -TSVM yields better generalization performance than SVM, ν -SVM, and ν -TSVM. Moreover, numerical experiments with different proportions of outliers demonstrate that our improved ν -TSVM is robust and stable. Finally, we apply our improved ν -TSVM to two BCI competition datasets, and also obtain better prediction accuracy.

Twin Support Vector Machines via Fast Generalized Newton Refinement

Improvements on twin support vector machines.

An Overview on Twin Support Vector Machines

Fixed-point Twin Support Vector Machine.

Weighted Twin Support Vector Machines with Local Information and Its Application.

An improved least squares Twin Support Vector Machine

A new improved support vector machine: QGA-SVM

A coordinate descent margin based-twin support vector machine for classification.

A GA-based Model Selection for Smooth Twin Parametric-Margin Support Vector Machine

-norm Twin Support Vector Machine-based Regression

Twin Support Vector Machines Based on Particle Swarm Optimization

Local and Global Regularized Twin SVM.

An Improved Ν-Twin Support Vector Machine

A Rough Margin-Based Ν-Twin Support Vector Machine

L2P-Norm Distance Twin Support Vector Machine.

A coordinate descent margin based-twin support vector machine for classification

A Novel Twin Support Vector Machines with Manifold Regularization

A Weighted Least Squares Twin Support Vector Machine.

Twin Support Vector Machine: Theory, Algorithm and Applications

Polynomial Smooth Twin Support Vector Machines

An Improved Nu-Twin Support Vector Machine