Abstract:Deep learning models for computer vision applications specifically and for machine learning generally are now the state of the art. The growth of size and complexity of neural networks has made them more and more reliable, yet in greater need of computational power and memory as is evident from the heavy reliance on graphical processing units and cloud computing for training them. As the complexity of deep neural networks increases, the need for fast processing neural networks in real-time embedded applications at the edge also increases and accelerating them using reconfigurable hardware suggests a solution. In this work, a convolutional neural network based on the inception net architecture is first optimized in software and then accelerated by taking advantage of field programmable gate array (FPGA) parallelism. Genetic algorithm augmented training is proposed and used on the neural network to produce an optimum model from the first training run without re-training iterations. Quantization of the network parameters is performed according to the weights of the network. The resulting neural network is then transformed into hardware by writing the register transfer level (RTL) code for FPGAs with exploitation of layer parallelism and a simple trial-and-error allocation of resources with the help of the roofline model. The approach is simple and easy to use as compared to many complex existing methods in literature and relies on trial and error to customize the FPGA design to the model needed to work on any computer vision or multimedia application deep learning model. Simulation and synthesis are performed. The results prove that the genetic algorithm reduces the number of back-propagation epochs in software and brings the network closer to the global optimum in terms of performance. Quantization to 16 bits also shows a reduction in network size by almost half with no performance drop. The synthesis of our design also shows that the Inception-based classifier is capable of achieving real-time performance of 74 frames per second at a clock speed of 70 MHz and around 900,000 cycles for an entire frame.

Nanosecond machine learning event classification with boosted decision trees in FPGA for high energy physics

Nanosecond machine learning regression with deep boosted decision trees in FPGA for high energy physics

Nanosecond hardware regression trees in FPGA at the LHC

Nanosecond anomaly detection with decision trees and real-time application to exotic Higgs decays

Ultrafast jet classification on FPGAs for the HL-LHC

Investigating Resource-efficient Neutron/Gamma Classification ML Models Targeting eFPGAs

Fast Neural Network Inference on FPGAs for Triggering on Long-Lived Particles at Colliders

FPGA-accelerated machine learning inference as a service for particle physics computing

Ultra-low latency quantum-inspired machine learning predictors implemented on FPGA

Embedded FPGA developments in 130 nm and 28 nm CMOS for machine learning in particle detector readout

Embedded FPGA Developments in 130nm and 28nm CMOS for Machine Learning in Particle Detector Readout

Towards Efficient and Scalable Acceleration of Online Decision Tree Learning on FPGA

Machine Learning for Real-Time Processing of ATLAS Liquid Argon Calorimeter Signals with FPGAs

Hardware Design of Lightweight Binary Classification Algorithms for Small-Size Images on FPGA

An FPGA Architecture for Online Learning using the Tsetlin Machine

Boosted decision trees approach to neck alpha events discrimination in DEAP-3600 experiment

Genetic Algorithm Augmented Inception-Net based Image Classifier Accelerated on FPGA

Machine learning evaluation in the Global Event Processor FPGA for the ATLAS trigger upgrade

Real-time Graph Building on FPGAs for Machine Learning Trigger Applications in Particle Physics

Low Latency Edge Classification GNN for Particle Trajectory Tracking on FPGAs