Abstract:Semi-supervised support vector machine (S 3 VM) is important because it can use plentiful unlabeled data to improve the generalization accuracy of traditional SVMs. In order to achieve good performance, it is necessary for S 3 VM to take some effective measures to select hyperparameters. However, model selection for semi-supervised models is still a key open problem. Existing methods for semi-supervised models to search for the optimal parameter values are usually computationally demanding, especially those ones with grid search. To address this challenging problem, in this article, we first propose solution paths of S 3 VM (SPS 3 VM), which can track the solutions of the nonconvex S 3 VM with respect to the hyperparameters. Specifically, we apply incremental and decremental learning methods to update the solution and let it satisfy the Karush-Kuhn-Tucker (KKT) conditions. Based on the SPS 3 VM and the piecewise linearity of model function, we can find the model with the minimum cross-validation (CV) error for the entire range of candidate hyperparameters by computing the error path of S 3 VM. Our SPS 3 VM is the first solution path algorithm for nonconvex optimization problem of semi-supervised learning models. We also provide the finite convergence analysis and computational complexity of SPS 3 VM. Experimental results on a variety of benchmark datasets not only verify that our SPS 3 VM can globally search the hyperparameters (regularization and ramp loss parameters) but also show a huge reduction of computational time while retaining similar or slightly better generalization performance compared with the grid search approach.

Entire Solution Path for Support Vector Machine for Positive and Unlabeled Classification

Novel Linear Search for Support Vector Machine Parameter Selection

A Novel Svm Modeling Approach For Highly Imbalanced And Overlapping Classification

An Unbalanced Dataset Classification Approach Based On V-Support Vector Machine

A Multi-Class Large Margin Classifier

Cost Sensitive Support Vector Machines

Absolute Value Inequality SVM for the PU Learning Problem

Large-Margin Label-Calibrated Support Vector Machines for Positive and Unlabeled Learning

SVM-based Cost Sensitive Mining

SVM Classification:Its Contents and Challenges

A New Method for SVM Hyper-parameters Optimization

SVM-Based Cost-sensitive Classification Algorithm with Error Cost and Class-dependent Reject Cost

An MPEC Model for Selecting Optimal Parameter in Support Vector Machines

Solution Path for Pin-SVM Classifiers with Positive and Negative $\tau $ Values

On support vector machines under a multiple-cost scenario

A hybrid method for speeding SVM training

Minimal Support Vector Machine

Cost-Sensitive Semi-Supervised Support Vector Machine

Global Model Selection for Semi-Supervised Support Vector Machine via Solution Paths

Convex large margin training techniques: unsupervised, semi-supervised, and robust support vector machines

Solving One-Class Problem with Outlier Examples by Svm