Abstract:<p>Support vector machine (SVM) is one of the extremely effective classification tools, which has been widely employed in real-world applications. However, it is time-consuming and sensitive to outliers. To address the above two limitations, on the one hand, a variety of safe screening strategies have recently emerged, whose major aim is to accelerate training without sacrificing accuracy. On the other hand, ramp support vector machine (RSVM) remains the sparsity and enhances robustness for outliers by introducing the ramp loss. Unfortunately, due to the fact that ramp loss is non-convex, the existing commonly applied method for solving RSVM is to convert it to a series of convex problems by concave-convex procedure (CCCP), which undoubtedly leads to the increased computational cost. Inspired by the aforementioned researches, we propose a two-stage safe screening method (TSS) for RSVM under the framework of CCCP, which contains the dual screening method with variational inequalities (DVI) and the dynamic screening rule (DSR) based on duality gap. In the first stage, by discarding those redundant samples, DVI reduces the scale of the optimization problem before training and initializes a more accurate feasible solution for the next stage. In the second stage, DSR is embedded into the solver for further acceleration. Finally, a post-checking procedure is conducted to guarantee the safety after the solution is obtained. Numerical experiments on five synthetic datasets and twelve real-world datasets demonstrate the feasibility and efficiency of TSS. Moreover, we extend TSS to other non-convex models and conduct experiments to further verify the validity and safety of our proposed method.</p>

Ramp Loss Linear Programming Support Vector Machine.

Coordinate Descent Algorithm for Ramp Loss Linear Programming Support Vector Machines

Flatheaded support vector machine for regression

Ramp Loss Based Robust One-Class SVM

Robust Support Vector Machine Using Least Median Loss Penalty

A two-stage safe screening method for non-convex support vector machine with ramp loss

Using Svm To Model And Control Nonlinear Dynamical Systems

A Novel Loss Function-based Support Vector Machine for Binary Classification

Support Vector Machine Classifier with Pinball Loss

Generalized robust loss functions for machine learning

Tightening big Ms in integer programming formulations for support vector machines with ramp loss

Sequential minimal optimization for SVM with pinball loss.

A nonlinear kernel SVM classifier via L 0 / 1 soft-margin loss with classification performance

Non-smooth optimization algorithm to solve the LINEX soft support vector machine

Linear Programming-Based Sparse Kernel Regression with L1-Norm Minimization for Nonlinear System Modeling

Unified Locally Linear Classifiers with Diversity-Promoting Anchor Points

Smooth pinball loss nonparallel support vector machine for robust classification

Improving Sparsity and Scalability in Regularized Nonconvex Truncated-Loss Learning Problems

Linearized alternating direction method of multipliers for elastic-net support vector machines

$p$SVM: Soft-margin SVMs with $p$-norm Hinge Loss

Learning with smooth Hinge losses