Abstract:Graph Neural Networks (GNNs) have shown great success in many applications such as recommendation systems, molecular property prediction, traffic prediction, etc. Recently, CPU-FPGA heterogeneous platforms have been used to accelerate many applications by exploiting customizable data path and abundant user-controllable on-chip memory resources of FPGAs. Yet, accelerating and deploying GNN training on such platforms requires not only expertise in hardware design but also substantial development efforts. We propose HP-GNN, a novel framework that generates high throughput GNN training implementations on a given CPU-FPGA platform that can benefit both application developers and machine learning researchers. HP-GNN takes GNN training algorithms, GNN models as the inputs, and automatically performs hardware mapping onto the target CPU-FPGA platform. HP-GNN consists of: (1) data layout and internal representation that reduce the memory traffic and random memory accesses; (2) optimized hardware templates that support various GNN models; (3) a design space exploration engine for automatic hardware mapping; (4) high-level application programming interfaces (APIs) that allows users to specify GNN training with only a handful of lines of code. To evaluate HP-GNN, we experiment with two well-known sampling-based GNN training algorithms and two GNN models. For each training algorithm and model, HP-GNN generates implementation on a state-of-the-art CPU-FPGA platform. Compared with CPU-only and CPU-GPU platforms, experimental results show that the generated implementations achieve $55.67\times$ and $2.17\times$ speedup on the average, respectively. Compared with the state-of-the-art GNN training implementations, HP-GNN achieves up to $4.45\times$ speedup.

GPU acceleration for network-on-chip yield evaluation

GPU Accelerated Computation for Surface Topography Measurement

DyGA: A Hardware-Efficient Accelerator with Traffic-Aware Dynamic Scheduling for Graph Convolutional Networks.

Fastgcn: A Gpu Accelerated Tool For Fast Gene Co-Expression Networks

Gpu-Accelerated Evaluation Platform For High Fidelity Network Modeling

NPGPU: Network processing on graphics processing units

3-D Surface Quality Evaluation Based on Graphics Processing Unit

An Efficient Acceleration of Symmetric Key Cryptography Using General Purpose Graphics Processing Unit

An efficient Network-on-Chip (NoC) based multicore platform for hierarchical parallel genetic algorithms

HP-GNN: Generating High Throughput GNN Training Implementation on CPU-FPGA Heterogeneous Platform

Accelerating RTL Simulation with GPUs

Accelerating Pcg Power/Ground Network Solver On Gpgpu

Accelerating Triangle Counting On Undirected Graph Using Gpu

Leveraging Silicon-Photonic Noc For Designing Scalable Gpus

High Performance Matrix Multiplication on General Purpose Graphics Processing Units

Speeding up homomorpic hashing using GPUs

GPU-Accelerated Static Timing Analysis

A parallel implementation of nearest neighbor analysis based on GPGPU

Nuclei: GPU-Accelerated Many-Core Network Coding

A Parallel Strategy to Accelerate Neighborhood Operation for Raster Data Coordinating CPU and GPU

High Performance Computing Via a GPU