Abstract:As many real-world applications are streaming and attached with time instances, a few works have been proposed to learn streaming graph neural networks (GNNs). Unfortunately, current streaming GNNs are observed to have a large training overhead and suffer from bad parallel scalability on multiple GPUs. These drawbacks pose severe challenges to online learning of streaming GNNs and their application to real-time scenarios. To improve training efficiency, one promising solution is to use sampling, a technique widely used in static GNNs. However, to the best of our knowledge, sampling has not been investigated in learning streaming GNNs. Based on these observations, in this paper, we propose T-GCN, the first sampling-based streaming GNN system, which targets temporal-aware streaming graphs and takes advantage of a hybrid CPU-GPU co-processing architecture to achieve high throughput and low latency. T-GCN proposes an efficient sampling method, namely Segment Its Search , to offer high sampling speed with respect to three typical types of general graph sampling methods (i.e., node-wise, layer-wise, and subgraph sampling). We propose a locality-aware data partitioning method to reduce CPU-GPU communication latency and data transfer overhead, and an NVLink-specific task schedule to fully exploit NVLink's fast speed and improve GPU-GPU communication efficiency. Besides, we further pipeline the computation and the communication by introducing an efficient memory management mechanism, to improve scalability while hiding data communication. Overall, with respect to end-to-end performance, for single-GPU training, T-GCN achieves up to 7.9× speedup than state-of-the-art works. In terms of scalability, T-GCN runs 5.2× faster on average with 8 GPUs than one GPU. Additionally, in terms of sampling, T-GCN also yields a maximum of 38.8× speedup with our Segment Its Search sampling method.

GeoT: Tensor Centric Library for Graph Neural Network via Efficient Segment Reduction on GPU

TC-GNN: Bridging Sparse GNN Computation and Dense Tensor Cores on GPUs

Efficient Graph Deep Learning in TensorFlow with tf_geometric

Connectivity-Based Segmentation for GPU-Accelerated Mesh Decompression

PCGCN: Partition-Centric Processing for Accelerating Graph Convolutional Network

BGL: GPU-Efficient GNN Training by Optimizing Graph Data I/O and Preprocessing

Empirical analysis of performance bottlenecks in graph neural network training and inference with GPUs

FastGL: A GPU-Efficient Framework for Accelerating Sampling-Based GNN Training at Large Scale

EnGN: A High-Throughput and Energy-Efficient Accelerator for Large Graph Neural Networks

Towards Efficient Large-Scale Graph Neural Network Computing.

VersaGNN: a Versatile accelerator for Graph neural networks

Geodesic Graph Neural Network for Efficient Graph Representation Learning

T-GCN: A Sampling Based Streaming Graph Neural Network System with Hybrid Architecture.

Towards Efficient Point Cloud Graph Neural Networks Through Architectural Simplification

fuseGNN: Accelerating Graph Convolutional Neural Network Training on GPGPU

PyTorch-Direct: Enabling GPU Centric Data Access for Very Large Graph Neural Network Training with Irregular Accesses

FreshGNN: Reducing Memory Access via Stable Historical Embeddings for Graph Neural Network Training

SIMPLE: Efficient Temporal Graph Neural Network Training at Scale with Dynamic Data Placement.

TGL: A General Framework for Temporal GNN Training on Billion-Scale Graphs

ByteGNN: Efficient Graph Neural Network Training at Large Scale

QGABS: GPU Tensor Core-accelerated Quantized Graph Neural Network based on Adaptive Batch Size