Abstract:This work presents a novel reconfigurable architecture for Low Latency Graph Neural Network (LL-GNN) designs for particle detectors, delivering unprecedented low latency performance. Incorporating FPGA-based GNNs into particle detectors presents a unique challenge since it requires sub-microsecond latency to deploy the networks for online event selection with a data rate of hundreds of terabytes per second in the Level-1 triggers at the CERN Large Hadron Collider experiments. This paper proposes a novel outer-product based matrix multiplication approach, which is enhanced by exploiting the structured adjacency matrix and a column-major data layout. In addition, we propose a custom code transformation for the matrix multiplication operations, which leverages the structured sparsity patterns and binary features of adjacency matrices to reduce latency and improve hardware efficiency. Moreover, a fusion step is introduced to further reduce the end-to-end design latency by eliminating unnecessary boundaries. Furthermore, a GNN-specific algorithm-hardware co-design approach is presented which not only finds a design with a much better latency but also finds a high accuracy design under given latency constraints. To facilitate this, a customizable template for this low latency GNN hardware architecture has been designed and open-sourced, which enables the generation of low-latency FPGA designs with efficient resource utilization using a high-level synthesis tool. Evaluation results show that our FPGA implementation is up to 9.0 times faster and achieves up to 13.1 times higher power efficiency than a GPU implementation. Compared to the previous FPGA implementations, this work achieves 6.51 to 16.7 times lower latency. Moreover, the latency of our FPGA design is sufficiently low to enable deployment of GNNs in a sub-microsecond, real-time collider trigger system, enabling it to benefit from improved accuracy. The proposed LL-GNN design advances the next generation of trigger systems by enabling sophisticated algorithms to process experimental data efficiently.

Real-time Graph Building on FPGAs for Machine Learning Trigger Applications in Particle Physics

Distance-Weighted Graph Neural Networks on FPGAs for Real-Time Particle Reconstruction in High Energy Physics

Fast Neural Network Inference on FPGAs for Triggering on Long-Lived Particles at Colliders

Fast inference of deep neural networks in FPGAs for particle physics

LL-GNN: Low Latency Graph Neural Networks on FPGAs for High Energy Physics

Graph Neural Networks for Charged Particle Tracking on FPGAs

FPGA-accelerated machine learning inference as a service for particle physics computing

Low Latency Edge Classification GNN for Particle Trajectory Tracking on FPGAs

Trigger Algorithm Development on FPGA-based Compute Nodes

Real-Time Inference With 2D Convolutional Neural Networks on Field Programmable Gate Arrays for High-Rate Particle Imaging Detectors

Analysis of Hardware Synthesis Strategies for Machine Learning in Collider Trigger and Data Acquisition

A Real-Time Spike Sorting Method Based on the Embedded GPU

Embedded FPGA Developments in 130nm and 28nm CMOS for Machine Learning in Particle Detector Readout

Ultra Fast Transformers on FPGAs for Particle Physics Experiments

Embedded FPGA developments in 130 nm and 28 nm CMOS for machine learning in particle detector readout

Machine learning evaluation in the Global Event Processor FPGA for the ATLAS trigger upgrade

Machine Learning for Real-Time Processing of ATLAS Liquid Argon Calorimeter Signals with FPGAs

Real-time Position Reconstruction for the KamLAND-Zen Experiment using Hardware-AI Co-design

A low-latency graph computer to identify metastable particles at the Large Hadron Collider for real-time analysis of potential dark matter signatures