End-to-end codesign of Hessian-aware quantized neural networks for FPGAs

Javier Campos,Jovan Mitrevski,Nhan Tran,Zhen Dong,Amir Gholaminejad,Michael W. Mahoney,Javier Duarte
DOI: https://doi.org/10.1145/3662000
IF: 2.837
2024-05-12
ACM Transactions on Reconfigurable Technology and Systems
Abstract:We develop an end-to-end workflow for the training and implementation of co-designed neural networks (NNs) for efficient field-programmable gate array (FPGA) hardware. Our approach leverages Hessian-aware quantization (HAWQ) of NNs, the Quantized Open Neural Network Exchange (QONNX) intermediate representation, and the hls4ml tool flow for transpiling NNs into FPGA firmware. This makes efficient NN implementations in hardware accessible to nonexperts, in a single open-sourced workflow that can be deployed for real-time machine-learning applications in a wide range of scientific and industrial settings. We demonstrate the workflow in a particle physics application involving trigger decisions that must operate at the 40 MHz collision rate of the CERN Large Hadron Collider (LHC). Given the high collision rate, all data processing must be implemented on FPGA hardware within the strict area and latency requirements. Based on these constraints, we implement an optimized mixed-precision NN classifier for high-momentum particle jets in simulated LHC proton-proton collisions.
computer science, hardware & architecture
What problem does this paper attempt to address?