Abstract:In the last few years, many scientific applications have been developed for powerful graphics processing units (GPUs) and have achieved remarkable speedups. This success can be partially attributed to high performance host callable GPU library routines that are offloaded to GPUs at runtime. These library routines are based on C/C++-like programming toolkits such as CUDA from NVIDIA and have the same calling signatures as their CPU counterparts. Recently, with the sufficient support of C++ templates from CUDA, the emergence of template libraries have enabled further advancement in code reusability and rapid software development for GPUs. However, Expression Templates (ET), which have been very popular for implementing data parallel scientific software for host CPUs because of their intuitive and mathematics-like syntax, have been underutilized by GPU development libraries. The lack of ET usage is caused by the difficulty of offloading expression templates from hosts to GPUs due to the inability to pass instantiated expressions to GPU kernels as well as the absence of the exact form of the expressions for the templates at the time of coding. This paper presents a general approach that enables automatic offloading of C++ expression templates to CUDA enabled GPUs by using the C++ metaprogramming technique and Just-In-Time (JIT) compilation methodology to generate and compile CUDA kernels for corresponding expression templates followed by executing the kernels with appropriate arguments. This approach allows developers to port applications to run on GPUs with virtually no code modifications. More specifically, this paper uses a large ET based data parallel physics library called QDP++ as an example to illustrate many aspects of the approach to offload expression templates automatically and to demonstrate very good speedups for typical QDP++ applications running on GPUs against running on CPUs using this method of offloading. In addition, this approach of automatic offloading expression templates could be applied to other many-core accelerators that provide C++ programming toolkits with the support of C++ template.

How C++ Templates Are Used for Generic Programming

How C++ Templates Are Used for Generic Programming

Code reuse in gene expression programming

A Language for Generic Programming in the Large

Component Thermodynamical Selection Based Gene Expression Programming for Function Finding

Systematic Mapping Study of Template-based Code Generation

Using Static Analysis to Extract C++0x Concepts

Runtime Template Instantiation for C++

Rethinking Answer Set Programming Templates

Advanced Programming Techniques for Construction of Robust, Generic and Evolutionary Programs

The Technical Analysis On Translation Templates

The Code-Reuse Technique Applicable for Object-Oriented Mode

To Follow or Not to Follow: Understanding Issue/Pull-Request Templates on GitHub

Object Orientation,Generic Programming and Type Constraint Checking

API usage templates via Structural Generalization

Automatic Offloading C++ Expression Templates to CUDA Enabled GPUs.

Overview of Type Constrained Programming in C

A methodology to identify the level of reuse using template factors

Generic Component: A Generic Programming Approach

Efficient Expression Templates for Operator Overloading-based Automatic Differentiation

A New Vectorization Technique for Expression Templates in C++