Abstract:Support Vector Machines (SVM) have been widely used in data-mining and Big Data applications as modern commercial databases start to attach an increasing importance to the analytic capabilities. In recent years, SVM was adapted to the field of High Performance Computing for power/performance prediction, auto-tuning, and runtime scheduling. However, even at the risk of losing prediction accuracy due to insufficient runtime information, researchers can only afford to apply offline model training to avoid significant runtime training overhead. Advanced multi- and many-core architectures offer massive parallelism with complex memory hierarchies which can make runtime training possible, but form a barrier to efficient parallel SVM design.To address the challenges above, we designed and implemented MIC-SVM, a highly efficient parallel SVM for x86 based multi-core and many-core architectures, such as the Intel Ivy Bridge CPUs and Intel Xeon Phi co-processor (MIC). We propose various novel analysis methods and optimization techniques to fully utilize the multilevel parallelism provided by these architectures and serve as general optimization methods for other machine learning tools.MIC-SVM achieves 4.4-84x and 18-47x speedups against the popular LIBSVM, on MIC and Ivy Bridge CPUs respectively, for several real-world data-mining datasets. Even compared with GPUSVM, running on the NVIDIA k20x GPU, the performance of our MIC-SVM is competitive. We also conduct a cross-platform performance comparison analysis, focusing on Ivy Bridge CPUs, MIC and GPUs, and provide insights on how to select the most suitable advanced architectures for specific algorithms and input data patterns. (C) 2014 Elsevier Inc. All rights reserved.

Support vector machine in big data: smoothing strategy and adaptive distributed inference

A Parallel and Scalable Digital Architecture for Training Support Vector Machines

A Novel Svm Modeling Approach For Highly Imbalanced And Overlapping Classification

Distributed Inference for Linear Support Vector Machine

Distributed Inference for Linear Support Vector Machine.

Distributed Bootstrap Simultaneous Inference for High-Dimensional Quantile Regression

Distributed Online Semi-Supervised Support Vector Machine

Byzantine-robust Distributed Support Vector Machine

Learning Performance of Weighted Distributed Learning With Support Vector Machines

Using Support Vector Machines for Mining Regression Classes in Large Data Sets

A Load-Balancing Divide-and-Conquer SVM Solver.

Soft Kernel Convex Hull Support Vector Machine for Large Scale Noisy Datasets

Incremental batch learning with support vector machines

Improvement of Support Vector Machine Algorithm in Big Data Background

Robust SVM with Adaptive Graph Learning.

A Fast-Convergence Distributed Support Vector Machine in Small-Scale Strongly Connected Networks

Scaling Support Vector Machines on Modern HPC Platforms

An Online Incremental Learning Support Vector Machine for Large-Scale Data

Distributed Estimation and Inference for Semi-parametric Binary Response Models

GADGET SVM: A Gossip-bAseD sub-GradiEnT Solver for Linear SVMs

BISVM:block-based incremental training algorithm of SVM for very large dataset