Abstract:In the last few years, many scientific applications have been developed for powerful graphics processing units (GPUs) and have achieved remarkable speedups. This success can be partially attributed to high performance host callable GPU library routines that are offloaded to GPUs at runtime. These library routines are based on C/C++-like programming toolkits such as CUDA from NVIDIA and have the same calling signatures as their CPU counterparts. Recently, with the sufficient support of C++ templates from CUDA, the emergence of template libraries have enabled further advancement in code reusability and rapid software development for GPUs. However, Expression Templates (ET), which have been very popular for implementing data parallel scientific software for host CPUs because of their intuitive and mathematics-like syntax, have been underutilized by GPU development libraries. The lack of ET usage is caused by the difficulty of offloading expression templates from hosts to GPUs due to the inability to pass instantiated expressions to GPU kernels as well as the absence of the exact form of the expressions for the templates at the time of coding. This paper presents a general approach that enables automatic offloading of C++ expression templates to CUDA enabled GPUs by using the C++ metaprogramming technique and Just-In-Time (JIT) compilation methodology to generate and compile CUDA kernels for corresponding expression templates followed by executing the kernels with appropriate arguments. This approach allows developers to port applications to run on GPUs with virtually no code modifications. More specifically, this paper uses a large ET based data parallel physics library called QDP++ as an example to illustrate many aspects of the approach to offload expression templates automatically and to demonstrate very good speedups for typical QDP++ applications running on GPUs against running on CPUs using this method of offloading. In addition, this approach of automatic offloading expression templates could be applied to other many-core accelerators that provide C++ programming toolkits with the support of C++ template.

GPU-S2S: A Compiler for Source-to-Source Translation on GPU

Providing Source Code Level Portability Between Cpu and Gpu with Mapcg

BabelTower: Learning to Auto-parallelized Program Translation.

High-Throughput Sequence Translation Using Cuda

Mapcg: Writing Parallel Program Portable Between Cpu And Gpu

GPU First -- Execution of Legacy CPU Codes on GPUs

A Compiler-assisted Locality Aware CTA Mapping Scheme

CuPBoP: CUDA for Parallelized and Broad-range Processors

High-Performance GPU-to-CPU Transpilation and Optimization via High-Level Parallel Constructs

swCUDA: Auto parallel code translation framework from CUDA to ATHREAD for new generation sunway supercomputer

GPU Parallel Computing: Programming Language, Debugging Tools and Data Structures

A Polyhedral Modeling Based Source-to-Source Code Optimization Framework for GPGPU

CuPBoP: Making CUDA a Portable Language

Bsgp: Bulk-Synchronous Gpu Programming

LASSI: An LLM-based Automated Self-Correcting Pipeline for Translating Parallel Scientific Codes

GPT-Driven Source-to-Source Transformation for Generating Compilable Parallel CUDA Code for Nussinov's Algorithm

An Efficient Compiler Framework for Cache Bypassing on GPUs

Exploiting the Task-Pipelined Parallelism of Stream Programs on Many-Core GPUs.

Source Code Migration of CUDA Program to Cell Platform

CUDA-Zero: a Framework for Porting Shared Memory GPU Applications to Multi-Gpus

Automatic Offloading C++ Expression Templates to CUDA Enabled GPUs.