Abstract:Structured Support Vector Machines (structured SVMs) are a fundamental machine learning algorithm, and have solid theoretical foundation and high effectiveness in applications such as natural language parsing and computer vision. However, training structured SVMs is very time-consuming, due to the large number of constraints and inferior convergence rates, especially for large training data sets. The high cost of training structured SVMs has hindered its adoption to new applications. In this article, we aim to improve the efficiency of structured SVMs by proposing a parallel and distributed solution (namely FastSSVM) for training structured SVMs building on top of MPI and OpenMP. FastSSVM exploits a series of optimizations (e.g., optimizations on data storage and synchronization) to efficiently use the resources of the nodes in a cluster and the cores of the nodes. Moreover, FastSSVM tackles the large constraint set problem by batch processing and addresses the slow convergence challenge by adapting stop conditions based on the improvement of each iteration. We theoretically prove that our solution is guaranteed to converge to a global optimum. A comprehensive experimental study shows that FastSSVM can achieve at least four times speedup over the existing solutions, and in some cases can achieve two to three orders of magnitude speedup.

Optimized Cutting Plane Method for Training a Structural SVM

Optimized Cutting Plane Method for Linear SVM via Inexact Step-Length Search

Novel Linear Search for Support Vector Machine Parameter Selection

A Parallel and Scalable Digital Architecture for Training Support Vector Machines

Active Set Based Cutting Plane Algorithm for SVM

A Scalable Hardware Implementation of the Support Vector Machine

A Faster Cutting Plane Algorithm with Accelerated Line Search for Linear SVM.

A Fast Training Method for OC-SVM Based on the Random Sampling Lemma

Recursive Training Algorithm for One-Class Support Vector Machine Based on Active Set Method

An Incremental Updating Method for Support Vector Machines

Parallel and Distributed Structured SVM Training

Smooth Ranking SVM via Cutting-Plane Method

On-line Support Vector Machine Training Algorithm and Its Application

Single Sequential Minimal Optimization: an Improved SVMs Training Algorithm

Cuts3vm: a fast semi-supervised svm algorithm.

Approximate Approach to Train SVM on Very Large Data Sets

An Improved SMO Algorithm Based on Trade-off Strategy

Non-smooth optimization algorithm to solve the LINEX soft support vector machine

SVM Based on Response Surface Method for Structural Reliability Analysis

Fast and Scalable Structural SVM with Slack Rescaling

Identification and Compensation for Volumetric Errors of CNC Machine Tools Based on SVM