Abstract:Structured Support Vector Machines (structured SVMs) are a fundamental machine learning algorithm, and have solid theoretical foundation and high effectiveness in applications such as natural language parsing and computer vision. However, training structured SVMs is very time-consuming, due to the large number of constraints and inferior convergence rates, especially for large training data sets. The high cost of training structured SVMs has hindered its adoption to new applications. In this article, we aim to improve the efficiency of structured SVMs by proposing a parallel and distributed solution (namely FastSSVM) for training structured SVMs building on top of MPI and OpenMP. FastSSVM exploits a series of optimizations (e.g., optimizations on data storage and synchronization) to efficiently use the resources of the nodes in a cluster and the cores of the nodes. Moreover, FastSSVM tackles the large constraint set problem by batch processing and addresses the slow convergence challenge by adapting stop conditions based on the improvement of each iteration. We theoretically prove that our solution is guaranteed to converge to a global optimum. A comprehensive experimental study shows that FastSSVM can achieve at least four times speedup over the existing solutions, and in some cases can achieve two to three orders of magnitude speedup.

On Parallel Learning Based on Support Vector Machines

A Parallel and Scalable Digital Architecture for Training Support Vector Machines

A Confident Majority Voting Strategy for Parallel and Modular Support Vector Machines

A Parallel SVM Training Algorithm on Large-Scale Classification Problems

Fast Training Support Vector Machines Using Parallel Sequential Minimal Optimization

An Improved Parallel SVM Algorithm on Distributed System

Parallelizing Support Vector Machines on Distributed Computers

An Improvement SVM Learning Algorithm with Parallel Processing

RESEARCH ON CASCADE-GROUPING PARALLEL SVM ALGORITHM BASED ON MAPREDUCE

Parallel Computing of Support Vector Machines

Optimization of Multi Kernel Parallel Support Vector Machine Based on Hadoop

Research on Parallel SVM Algorithm Based on Cascade SVM

Parallel Support Vector Machines in Practice

A Novel Parallel Reduced Support Vector Machine

The Research of the Parallel Smo Algorithm for Solving Svm

A Part-Versus-part Method for Massively Parallel Training of Support Vector Machines

Parallel Proximal Support Vector Machine for High-Dimensional Pattern Classification

Non-parallel planes support vector machine for multi-class classification

Fast Parallel SVM using Data Augmentation

Parallel and Distributed Structured SVM Training

Parallel Implementation of Gradient-Based Neural Networks for Svm Training