Abstract:GPUs offer the promise of massive, power-efficient parallelism. However, exploiting this parallelism requires code to be carefully structured to deal with the limitations of the SIMT execution model. In recent years, there has been much interest in mapping irregular applications to GPUs: applications with unpredictable, data-dependent behaviors. While most of the work in this space has focused on ad hoc implementations of specific algorithms, recent work has looked at generic techniques for mapping a large class of tree traversal algorithms to GPUs, through careful restructuring of the tree traversal algorithms to make them behave more regularly. Unfortunately, even this general approach for GPU execution of tree traversal algorithms is reliant on ad hoc , handwritten, algorithm-specific scheduling ( i.e. , assignment of threads to warps) to achieve high performance. The key challenge of scheduling is that it is a highly irregular process, that requires the inspection of thread behavior and then careful sorting of the threads into warps. In this paper, we present a novel scheduling and execution technique for tree traversal algorithms that is both general and automatic. The key novelty is a hybrid approach: the GPU partially executes tasks to inspect thread behavior and transmits information back to the CPU, which uses that information to perform the scheduling itself, before executing the remaining, carefully scheduled, portion of the traversals on the GPU. We applied this framework to five tree traversal algorithms, achieving significant speedups over optimized GPU code that does not perform application-specific scheduling. Further, we show that in many cases, our hybrid approach is able to deliver better performance even than GPU code that uses hand-tuned, application-specific scheduling.

Optimization Method for Reusing GPU Data Based on Dynamic Spanning Tree

Efficient Data Management for Incoherent Ray Tracing.

A Run-Time Optimization Approach for Reducing Data Movements Using Locality-Aware Searching

GPU Memory Optimization Through Program Restructuring Methods

A Polyhedral Modeling Based Source-to-Source Code Optimization Framework for GPGPU

Optimizing stencil application on multi-thread GPU architecture using stream programming model

Program Optimization of Stencil Based Application on the GPU-Accelerated System

GPU Performance Optimization Targeting OpenCL Model

Parallel Volume Rendering Based on LOD Method

GPU-based Dynamic Quad Stream for Forest Rendering

Optimizing execution for pipelined‐based distributed deep learning in a heterogeneously networked GPU cluster

Balancing Cpu And Gpu: Real-Time Visualization Of Large Scale 3d Scanning Models

OpenCL-Based Real-Time KD-Tree and Raytracing for Dynamic Scene

Data-Driven Analysis to Understand GPU Hardware Resource Usage of Optimizations

Profiling Based Optimization Method for CPU-GPU Heterogeneous Parallel Processing System

Register and Thread Structure Optimization for GPUs

Hybrid CPU-GPU scheduling and execution of tree traversals

An Efficient Update Mechanism for GPU-Based IP Lookup Engine Using Threaded Segment Tree

On-the-fly Vertex Reuse for Massively-Parallel Software Geometry Processing

An Efficient Data Reuse Strategy for Multi-Pattern Data Access.

An Accurate GPU Performance Model for Effective Control Flow Divergence Optimization.