Abstract:This research proposes a 1-norm regularized linear programming nonparallel hyperplane support vector machine (LNSVM) model to solve binary classification problems and enhance the robustness performance. Numerous nonparallel support vector machine (SVM) models have been studied with outstanding performance on classification tasks. However, most nonparallel SVM models require two independent models to determine hyperplanes. In addition, due to the involvement of the 2-norm terms, traditional SVM models may suffer from the lack of robustness to outliers and irrelevant features. Therefore, the LNSVM model is proposed by reformulating a typical nonparallel SVM model through the 1-norm regularization. By applying the exterior penalty theory, the proposed LNSVM model is converted to the dual exterior penalty problem, which is solved by the Newton–Armijo algorithm. The essential differences that distinguish the LNSVM model from other nonparallel SVM models are: (1) Different from typical nonparallel SVM models, which solve two quadratic programming (QP) problems, the proposed LNSVM model determines two nonparallel hyperplanes simultaneously by solving a single linear programming (LP) model; (2) The robustness performance of the proposed LNSVM model has been enhanced to tolerate noisy data through the involvement of 1-norm loss function, which can also eliminate redundant features by generating sparse solution during the training procedure. The performance of the proposed LNSVM model is tested through a comparison with state-of-art SVM-based classifiers using a synthetic dataset and 11 practical benchmark datasets. The experimental results show the superiority of the proposed LNSVM model, by achieving better classification performance regarding accuracy, sensitivity, specificity, and removing redundant features synchronously.

A Nonlinear Kernel SVM Classifier Via L0/1 Soft-Margin Loss with Classification Performance.

A nonlinear kernel SVM classifier via L 0 / 1 soft-margin loss with classification performance

Nonlinear Kernel Support Vector Machine with 0-1 Soft Margin Loss

Using Svm To Model And Control Nonlinear Dynamical Systems

Support Vector Machine Classifier Via $L_{0/1}$ Soft-Margin Loss

Nonlinear kernel-free quadratic hyper-surface support vector machine with 0-1 loss function

A 1-Norm Regularized Linear Programming Nonparallel Hyperplane Support Vector Machine for Binary Classification Problems

Kernel-free Reduced Quadratic Surface Support Vector Machine with 0-1 Loss Function and L _p -norm Regularization

A Novel Loss Function-based Support Vector Machine for Binary Classification

Linear Programming-Based Sparse Kernel Regression with L1-Norm Minimization for Nonlinear System Modeling

Variant of Gaussian kernel and parameter setting method for nonlinear SVM

Unified Locally Linear Classifiers with Diversity-Promoting Anchor Points

Non-smooth optimization algorithm to solve the LINEX soft support vector machine

A Semismooth-Newton's-Method-Based Linearization and Approximation Approach for Kernel Support Vector Machines

Sparse Least Squares Support Vector Machine with L0-norm in Primal Space.

Nonparallel Support Vector Machine with L2-norm Loss and Its DCD-type Solver

An ADMM Solver for the MKL-$L_{0/1}$-SVM

A New Fast ADMM for Kernelless SVM Classifier with Truncated Fraction Loss

L2-Loss nonparallel bounded support vector machine for robust classification and its DCD-type solver

Design of Semi-Tensor Product-Based Kernel Function for SVM Nonlinear Classification

Nonlinear Combination of Multiple Kernels for Support Vector Machines