Abstract:This research proposes a 1-norm regularized linear programming nonparallel hyperplane support vector machine (LNSVM) model to solve binary classification problems and enhance the robustness performance. Numerous nonparallel support vector machine (SVM) models have been studied with outstanding performance on classification tasks. However, most nonparallel SVM models require two independent models to determine hyperplanes. In addition, due to the involvement of the 2-norm terms, traditional SVM models may suffer from the lack of robustness to outliers and irrelevant features. Therefore, the LNSVM model is proposed by reformulating a typical nonparallel SVM model through the 1-norm regularization. By applying the exterior penalty theory, the proposed LNSVM model is converted to the dual exterior penalty problem, which is solved by the Newton–Armijo algorithm. The essential differences that distinguish the LNSVM model from other nonparallel SVM models are: (1) Different from typical nonparallel SVM models, which solve two quadratic programming (QP) problems, the proposed LNSVM model determines two nonparallel hyperplanes simultaneously by solving a single linear programming (LP) model; (2) The robustness performance of the proposed LNSVM model has been enhanced to tolerate noisy data through the involvement of 1-norm loss function, which can also eliminate redundant features by generating sparse solution during the training procedure. The performance of the proposed LNSVM model is tested through a comparison with state-of-art SVM-based classifiers using a synthetic dataset and 11 practical benchmark datasets. The experimental results show the superiority of the proposed LNSVM model, by achieving better classification performance regarding accuracy, sensitivity, specificity, and removing redundant features synchronously.

Support Vector Machines Regression with L1-Regularizer

L1-Norm Least Squares Support Vector Regression Via the Alternating Direction Method of Multipliers

Using Svm To Model And Control Nonlinear Dynamical Systems

A Smoothing Algorithm for l1 Support Vector Machines

M-estimator Based Support Vector Machine and Its Application

A nonlinear kernel SVM classifier via L 0 / 1 soft-margin loss with classification performance

Radius-margin Based Support Vector Machine with LogDet Regularizaron.

Adaptive Regularization for Transductive Support Vector Machine.

A 1-Norm Regularized Linear Programming Nonparallel Hyperplane Support Vector Machine for Binary Classification Problems

Sparse Least Squares Support Vector Machine for Function Estimation

Regularization approaches for support vector machines with applications to biomedical data

L-SVM: A Radius-Margin-based SVM Algorithm with LogDet Regularization.

Concentration Estimates for Learning with ℓ1-Regularizer and Data Dependent Hypothesis Spaces

Minimal Support Vector Machine

Sparse Norm-Regularized Reconstructive Coefficients Learning

Linear Programming-Based Sparse Kernel Regression with L1-Norm Minimization for Nonlinear System Modeling

A New Algorithm for Computation of A Regularization Solution Path for Reinforced Multicategory Support Vector Machines

Regularized Regression Problem in hyper-RKHS for Learning Kernels

Comparison of &Lt;inline-Formula> &Lt;tex-Math Notation="latex">$\ell _{1}$ &Lt;/tex-Math></inline-formula>-norm SVR and Sparse Coding Algorithms for Linear Regression

Comparison of $\ell _{1}$ -Norm SVR and Sparse Coding Algorithms for Linear Regression

Incremental algorithm for regression least-squares support vector machines