Abstract:Support Vector Machine (SVM) has been widely used in data-mining and Big Data applications as modern commercial databases start to attach an increasing importance to the analytic capabilities. In recent years, SVM was adapted to the field of High Performance Computing for power/performance prediction, auto-tuning, and runtime scheduling. However, even at the risk of losing prediction accuracy due to insufficient runtime information, researchers can only afford to apply offline model training to avoid significant runtime training overhead. Advanced multi- and many-core architectures offer massive parallelism with complex memory hierarchies which can make runtime training possible, but form a barrier to efficient parallel SVM design. To address the challenges above, we designed and implemented MIC-SVM, a highly efficient parallel SVM for x86 based multi-core and many-core architectures, such as the Intel Ivy Bridge CPUs and Intel Xeon Phi co-processor (MIC). We propose various novel analysis methods and optimization techniques to fully utilize the multilevel parallelism provided by these architectures and serve as general optimization methods for other machine learning tools. MIC-SVM achieves 4.4-84x and 18-47x speedups against the popular LIBSVM, on MIC and Ivy Bridge CPUs respectively, for several real-world data-mining datasets. Even compared with GPUSVM, run on a top of the line NVIDIA k20x GPU, the performance of our MIC-SVM is competitive. We also conduct a cross-platform performance comparison analysis, focusing on Ivy Bridge CPUs, MIC and GPUs, and provide insights on how to select the most suitable advanced architectures for specific algorithms and input data patterns.

Micmr: an Efficient Mapreduce Framework for Cpu-Mic Heterogeneous Architecture

Optimizing the MapReduce Framework for CPU-MIC Heterogeneous Cluster

An Efficient MapReduce Framework for Intel MIC Cluster.

Mcrpl: a General Purpose Parallel Raster Processing Library on Distributed Heterogeneous Architectures.

A CPU/MIC Collaborated Parallel Framework for GROMACS on Tianhe-2 Supercomputer

Optimizing the MapReduce Framework on Intel Xeon Phi Coprocessor

Efficient Execution of Microscopy Image Analysis on CPU, GPU, and MIC Equipped Cluster Systems

FPMR: MapReduce framework on FPGA.

MICA: A fast short-read aligner that takes full advantage of Intel Many Integrated Core Architecture (MIC)

Performance Analysis and Efficient Execution on Systems with multi-core CPUs, GPUs and MICs

The performance of MapReduce: an in-depth study

MIC-SVM: A Highly Efficient Support Vector Machine For Modern HPC Architectures

Accelerating HPCG on Tianhe-2: A hybrid CPU-MIC algorithm

A-MapCG: an Adaptive MapReduce Framework for GPUs.

Heterogeneous Concurrent Execution of Monte Carlo Photon Transport on CPU, GPU and MIC

Fpmr: Map Reduce Framework on Fpga A Case Study of Rankboost Acceleration

A Coarse-Grained Reconfigurable Architecture for Compute-Intensive MapReduce Acceleration

Providing Source Code Level Portability Between Cpu and Gpu with Mapcg

Accelerated 3 D Full Band Self-consistent Ensemble Monte Carlo Device Simulation Utilizing Intel MIC Coprocessors on TianHe II

MIC-SVM: Designing a Highly Efficient Support Vector Machine for Advanced Modern Multi-core and Many-Core Architectures

SuperMIC: Analyzing Large Biological Datasets in Bioinformatics with Maximal Information Coefficient