Abstract:Graphics processors (GPUs) have recently emerged as powerful coprocessors for general purpose computation. Compared with commodity CPUs, GPUs have an order of magnitude higher computation power as well as memory bandwidth. Moreover, new-generation GPUs allow writes to random memory locations, provide efficient interprocessor communication through on-chip local memory, and support a general purpose parallel programming model. Nevertheless, many of the GPU features are specialized for graphics processing, including the massively multithreaded architecture, the Single-Instruction-Multiple-Data processing style, and the execution model of a single application at a time. Additionally, GPUs rely on a bus of limited bandwidth to transfer data to and from the CPU, do not allow dynamic memory allocation from GPU kernels, and have little hardware support for write conflicts. Therefore, a careful design and implementation is required to utilize the GPU for coprocessing database queries. In this article, we present our design, implementation, and evaluation of an in-memory relational query coprocessing system, GDB, on the GPU. Taking advantage of the GPU hardware features, we design a set of highly optimized data-parallel primitives such as split and sort, and use these primitives to implement common relational query processing algorithms. Our algorithms utilize the high parallelism as well as the high memory bandwidth of the GPU, and use parallel computation and memory optimizations to effectively reduce memory stalls. Furthermore, we propose coprocessing techniques that take into account both the computation resources and the GPU-CPU data transfer cost so that each operator in a query can utilize suitable processors—the CPU, the GPU, or both—for an optimized overall performance. We have evaluated our GDB system on a machine with an Intel quad-core CPU and an NVIDIA GeForce 8800 GTX GPU. Our workloads include microbenchmark queries on memory-resident data as well as TPC-H queries that involve complex data types and multiple query operators on data sets larger than the GPU memory. Our results show that our GPU-based algorithms are 2--27x faster than their optimized CPU-based counterparts on in-memory data. Moreover, the performance of our coprocessing scheme is similar to, or better than, both the GPU-only and the CPU-only schemes.

GRAP: Efficient GPU-Based Redundancy Analysis Using Parallel Evaluation for Cross Faults

PRODA: Improving Parallel Programs on GPUs Through Dependency Analysis

Efficient Repair Analysis Algorithm Exploration for Memory with Redundancy and In-Memory ECC

Understanding the Effects of Permanent Faults in GPU's Parallelism Management and Control Units

Combining Memory Partitioning and Subtask Generation for Parallel Data Access on CGRAs

Batch-Aware Unified Memory Management in GPUs for Irregular Workloads

GPU Memory Optimization Through Program Restructuring Methods

RTGPU: Real-Time GPU Scheduling of Hard Deadline Parallel Tasks With Fine-Grain Utilization

Novel parallel hybrid genetic algorithms on the GPU for the generalized assignment problem

POSTER: Accelerate GPU Concurrent Kernel Execution by Mitigating Memory Pipeline Stalls

Enabling Software Resilience in GPGPU Applications via Partial Thread Protection

Exploiting Memory Access Patterns to Improve Memory Performance in Data-Parallel Architectures

GraphR: Accelerating Graph Processing Using ReRAM

Adaptive Multidimensional Parallel Fault Simulation Framework on Heterogeneous System

Exploring the Diversity of Multiple Job Deployments over GPUs for Efficient Resource Sharing

Nonlinear Dynamic Analysis Efficiency by Using A Gpu Parallelization

Advanced hybrid MRAM based novel GPU cache system for graphic processing with high efficiency

A dynamic analysis algorithm for RC frames using parallel GPU strategies

A Run-Time Optimization Approach for Reducing Data Movements Using Locality-Aware Searching

Relational Query Co-Processing on Graphics Processors1

HeteroCPPR: Accelerating Common Path Pessimism Removal with Heterogeneous CPU-GPU Parallelism