Abstract:In this paper, we propose a new feature selection approach for the recently proposed Least Squares Projection Twin Support Vector Machine (LSPTSVM) for binary classification. 1-norm is used in our feature selection objective so that only non-zero elements in weight vectors will be chosen as selected features. Also, the Tikhonov regularization term is incorporated to the objective of our approach to reduce the singularity problems of Quadratic Programming Problems (QPPs), and then to minimize its 1-norm measure. This approach leads to a strong feature suppression capability, called as Feature Selection for Least Squares Projection Twin Support Vector Machine (FLSPTSVM). The solutions of FLSPTSVM can be obtained by solving two smaller QPPS arising from two primal QPPs as opposed to two dual ones in Twin Support Vector Machine (TWSVM). Thus, FLSPTSVM is capable of generating sparse solutions. This means that FLSPTSVM can reduce the number of input features for a linear case. Our linear FLSPTSVM can also be extended to a nonlinear case with the kernel trick. When a nonlinear classifier is used, the number of kernel functions required for the classifier is reduced. Our experiments on publicly available datasets demonstrate that our FLSPTSVM has comparable classification accuracy to that of LSPTSVM and obtains sparse solutions.

A Novel Least Square Twin Support Vector Regression.

Primal least squares twin support vector regression

Sparse Least Square Twin Support Vector Machine with Adaptive Norm

Least Squares Twin Parametric Insensitive Support Vector Regression

An Improved Robust and Sparse Twin Support Vector Regression Via Linear Programming

L1-Norm Least Squares Support Vector Regression Via the Alternating Direction Method of Multipliers

Sparse Least Squares Support Vector Machine with L0-norm in Primal Space.

An Ε-Twin Support Vector Machine for Regression.

Training Twin Support Vector Regression Via Linear Programming

An Efficient Twin Projection Support Vector Machine for Regression

Asymmetric Ν-Twin Support Vector Regression.

A weighted twin support vector regression

An improved least squares Twin Support Vector Machine

Robust Least Squares Projection Twin Support Vector Machine and Its Sparse Solution

A Weighted Least Squares Twin Support Vector Machine.

Least squares twin parametric-margin support vector machine for classification

-norm Twin Support Vector Machine-based Regression

A Projection Wavelet Weighted Twin Support Vector Regression and Its Primal Solution

Feature selection for least squares projection twin support vector machine

L2P-Norm Distance Twin Support Vector Machine.