Abstract:Utilizing GPUs is critical for high performance on heterogeneous systems. However, leveraging the full potential of GPUs for accelerating legacy CPU applications can be a challenging task for developers. The porting process requires identifying code regions amenable to acceleration, managing distinct memories, synchronizing host and device execution, and handling library functions that may not be directly executable on the device. This complexity makes it challenging for non-experts to leverage GPUs effectively, or even to start offloading parts of a large legacy application. In this paper, we propose a novel compilation scheme called "GPU First" that automatically compiles legacy CPU applications directly for GPUs without any modification of the application source. Library calls inside the application are either resolved through our partial libc GPU implementation or via automatically generated remote procedure calls to the host. Our approach simplifies the task of identifying code regions amenable to acceleration and enables rapid testing of code modifications on actual GPU hardware in order to guide porting efforts. Our evaluation on two HPC proxy applications with OpenMP CPU and GPU parallelism, four micro benchmarks with originally GPU only parallelism, as well as three benchmarks from the SPEC OMP 2012 suite featuring hand-optimized OpenMP CPU parallelism showcases the simplicity of porting host applications to the GPU. For existing parallel loops, we often match the performance of corresponding manually offloaded kernels, with up to 14.36x speedup on the GPU, validating that our GPU First methodology can effectively guide porting efforts of large legacy applications.

A Review on General Purpose Computing on GPUs and Its Applications in Computational Intelligence

Application of Graphics Processors to Database Technologies

A Review of Recent Hardware and Software Advances in GPU-Accelerated Edge-Computing Single-Board Computers (SBCs) for Computer Vision

High Performance Computing Via a GPU

Parallel data mining techniques on Graphics Processing Unit with Compute Unified Device Architecture (CUDA)

GPU Parallel Computing: Programming Language, Debugging Tools and Data Structures

Parallel Transient Stability-Constrained Optimal Power Flow Using GPU as Coprocessor.

Graphics processing units in bioinformatics, computational biology and systems biology

PConG: A Novel Platform Available for Pervasive Computing Based on GPU

Evaluating the Potential of Graphics Processors for High Performance Embedded Computing

A Study of Performance Programming of CPU, GPU accelerated Computers and SIMD Architecture

Implementation and evaluation of deep neural networks (DNN) on mainstream heterogeneous systems

Power-aware Programming with GPU Accelerators

A Performance Model for General-Purpose Computation on GPU

Accelerated GPU Computing Technology for Parallel Management Systems

GPU-Acceleration of Parallel Unconditionally Stable Group Explicit Finite Difference Method

Tools for GPU Computing - Debugging and Performance Analysis of Heterogenous HPC Applications

Overcoming Limitations of GPGPU-Computing in Scientific Applications

Impact of CUDA and OpenCL on Parallel and Distributed Computing

GPU First -- Execution of Legacy CPU Codes on GPUs

Research and implementation of key technologies for grid computing based on GPU