Abstract:Over the past decades, 1-norm techniques based on algorithms are widely used to suppress input features. Quite different from traditional 1-norm support vector machine SVM, direct 1-norm optimization based on the primal problem of nonparallel plane classifiers like generalized proximal support vector machine, twin support vector machine TWSVM and least squares twin support vector machine LSTSVM are not capable of generating very sparse solutions that are vital for classification and can make them easier to store and faster to compute. To address the issue, in this paper, we develop a feature selection method for LSTSVM, called a feature selection method for nonparallel plane support vector machine classificationFLSTSVM, which is specially designed for strong feature suppression. We incorporate a Tikhonov regularization term to the objective of LSTSVM, and then minimize its 1-norm measure. Solution of FLSTSVM can follow directly from solving two smaller quadratic programming problems QPPs arising from two primal QPPs as opposed to two dual ones in TWSVM. FLSTSVM is capable of generating very sparse solutions. This means that FLSTSVM can reduce input features, for the linear case. When a nonlinear classifier is used, few kernel functions determine the classifier. In addition to having strong feature suppression, the edge of our method still lies in its faster computing time compared to that of TWSVM, Newton Method for Linear Programming SVM NLPSVM and LPNewton. Lastly, this algorithm is compared on public data sets, as well as an Exclusive Or XOR example.

Sparse Least Square Twin Support Vector Machine with Adaptive Norm

L2P-Norm Distance Twin Support Vector Machine.

A Novel Least Square Twin Support Vector Regression.

A Weighted Least Squares Twin Support Vector Machine.

Least squares twin bounded support vector machines based on L1-norm distance metric for classification.

An improved least squares Twin Support Vector Machine

Sparse Least Squares Support Vector Machine with L0-norm in Primal Space.

A Feature Selection Method for Nonparallel Plane Support Vector Machine Classification

Structural Least Square Twin Support Vector Machine for Classification

-norm Twin Support Vector Machine-based Regression

Least squares twin parametric-margin support vector machine for classification

Entropy-Based Fuzzy Least Squares Twin Support Vector Machine for Pattern Classification.

Improved 2-norm Based Fuzzy Least Squares Twin Support Vector Machine

Weighted Least Squares Projection Twin Support Vector Machines With Local Information

L1-norm Loss-Based Projection Twin Support Vector Machine for Binary Classification

Sparse Hidden Space Support Vector Machine

Efficient and Robust TWSVM Classification Via a Minimum L1-norm Distance Metric Criterion

Mixed-norm linear support vector machine

Weighted Twin Support Vector Machines with Local Information and Its Application.

The Support Vector Regression with Adaptive Norms