Abstract:Over the past decades, 1-norm techniques based on algorithms are widely used to suppress input features. Quite different from traditional 1-norm support vector machine SVM, direct 1-norm optimization based on the primal problem of nonparallel plane classifiers like generalized proximal support vector machine, twin support vector machine TWSVM and least squares twin support vector machine LSTSVM are not capable of generating very sparse solutions that are vital for classification and can make them easier to store and faster to compute. To address the issue, in this paper, we develop a feature selection method for LSTSVM, called a feature selection method for nonparallel plane support vector machine classificationFLSTSVM, which is specially designed for strong feature suppression. We incorporate a Tikhonov regularization term to the objective of LSTSVM, and then minimize its 1-norm measure. Solution of FLSTSVM can follow directly from solving two smaller quadratic programming problems QPPs arising from two primal QPPs as opposed to two dual ones in TWSVM. FLSTSVM is capable of generating very sparse solutions. This means that FLSTSVM can reduce input features, for the linear case. When a nonlinear classifier is used, few kernel functions determine the classifier. In addition to having strong feature suppression, the edge of our method still lies in its faster computing time compared to that of TWSVM, Newton Method for Linear Programming SVM NLPSVM and LPNewton. Lastly, this algorithm is compared on public data sets, as well as an Exclusive Or XOR example.

Feature selection with kernelized multi-class support vector machine

Feature Selection and Parameter Optimization for Support Vector Machines: A New Approach Based on Genetic Algorithm with Feature Chromosomes.

Gene Selection Using Gaussian Kernel Support Vector Machine Based Recursive Feature Elimination with Adaptive Kernel Width Strategy

Parameters Selection in Gene Selection Using Gaussian Kernel Support Vector Machines by Genetic Algorithm

Support Vector Machine-Recursive Feature Elimination for Localized Feature Selection

Multiclass feature selection algorithms base on R-SVM

Feature Selection Via Scaling Factor Integrated Multi-Class Support Vector Machines

An Adaptive Feature Selection Method for Multi-Class Classification.

Multiclass Cancer Classification by Using Fuzzy Support Vector Machine and Binary Decision Tree with Gene Selection

A Fast SVM-based Feature Selection Method

Multiclass Kernel Polarization and Its Application to Parameter Selection of RBF Kernel with Multiple Widths

Latent regularization for feature selection using kernel methods in tumor classification

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

Feature Selection in a Kernel Space

A Feature Selection Method for Nonparallel Plane Support Vector Machine Classification

Feature Expansion and Feature Selection for General Pattern Recognition Problems

Accelerated multi-kernel sparse stochastic optimization classifier algorithm for explainable prediction

Accelerated Recursive Feature Elimination Based on Support Vector Machine for Key Variable Identification

Multi-View Scaling Support Vector Machines for Classification and Feature Selection.

Graph-based Extreme Feature Selection for Multi-class Classification Tasks

Feature subset selection for kernel SVM classification via mixed-integer optimization