Abstract:The recently proposed projection twin support vector machine (PTSVM) is an excellent nonparallel classifier. However, PTSVM employs the least-squares loss function to measure its within-class empirical risk, resulting in several drawbacks, such as non-sparseness for decision, sensitivity to outliers, expensive matrix inversion, and inconsistency in the linear and nonlinear models. To alleviate these issues, in this paper, we propose a novel nonparallel sparse projection support vector machine (NPrSVM). Different from the original PTSVM that squeezes the projected values of within-class instances to its own class center, NPrSVM aims to cluster them as much as possible within an insensitive tube. Specifically, our NPrSVM owns the following attractive merits: (i) Benefiting from the L1-norm symmetric Hinge loss function, NPrSVM not only enjoys sparseness for decision but also improves robustness to outliers. (ii) The elegant formulation of dual problems in NPrSVM no longer involves the matrix inversion during the training procedure. This greatly saves the computing time compared to PTSVM. (iii) While the nonlinear formulation of PTSVM is not the direct extension of linear PTSVM, the linear and nonlinear versions of our NPrSVM are consistent. (iv) An efficient dual coordinate descent algorithm is further designed for NPrSVM to handle large-scale classification. Finally, the feasibility and effectiveness of NPrSVM are validated by extensive experiments on both synthetic and real-world datasets.

A New Type Svm - Projected Svm

Pre -extracting Support Vector for Support Vector Machine Based on Vector Projection

A Novel Projection Nonparallel Support Vector Machine for Pattern Classification

NPrSVM: Nonparallel Sparse Projection Support Vector Machine with Efficient Algorithm

Parallel Proximal Support Vector Machine for High-Dimensional Pattern Classification

SVM Classification:Its Contents and Challenges

Dynamic least squares support vector machine

Proximal Parametric-Margin Support Vector Classifier and Its Applications

An Improved Nonparallel Support Vector Machine.

Variable Projection Support Vector Machines and Some Applications Using Adaptive Hermite Expansions

Using Novel Support Vector Machines for Efficient Classification

Study and application of an improved SVM

Two Effective Sample Selection Methods for Support Vector Machine

Fast Support Vector Machine with Low-Computational Complexity for Large-Scale Classification

A Fast Two-Stage Classification Method of Support Vector Machines

PMSVM: an Optimized Support Vector Machine Classification Algorithm Based on PCA and Multilevel Grid Search Methods

Support Vector Machines for Classification Problems

A New Support Vector Machine for the Classification of Positive and Unlabeled Examples

Explanation based generalized /spl epsi/-SVM and its application in intelligent project management

FS_SFS: A Novel Feature Selection Method for Support Vector Machines

Support Feature Machines