Abstract:Deep learning models for computer vision applications specifically and for machine learning generally are now the state of the art. The growth of size and complexity of neural networks has made them more and more reliable, yet in greater need of computational power and memory as is evident from the heavy reliance on graphical processing units and cloud computing for training them. As the complexity of deep neural networks increases, the need for fast processing neural networks in real-time embedded applications at the edge also increases and accelerating them using reconfigurable hardware suggests a solution. In this work, a convolutional neural network based on the inception net architecture is first optimized in software and then accelerated by taking advantage of field programmable gate array (FPGA) parallelism. Genetic algorithm augmented training is proposed and used on the neural network to produce an optimum model from the first training run without re-training iterations. Quantization of the network parameters is performed according to the weights of the network. The resulting neural network is then transformed into hardware by writing the register transfer level (RTL) code for FPGAs with exploitation of layer parallelism and a simple trial-and-error allocation of resources with the help of the roofline model. The approach is simple and easy to use as compared to many complex existing methods in literature and relies on trial and error to customize the FPGA design to the model needed to work on any computer vision or multimedia application deep learning model. Simulation and synthesis are performed. The results prove that the genetic algorithm reduces the number of back-propagation epochs in software and brings the network closer to the global optimum in terms of performance. Quantization to 16 bits also shows a reduction in network size by almost half with no performance drop. The synthesis of our design also shows that the Inception-based classifier is capable of achieving real-time performance of 74 frames per second at a clock speed of 70 MHz and around 900,000 cycles for an entire frame.

Real-Time Adaptive Neural Network on FPGA: Enhancing Adaptability through Dynamic Classifier Selection

A Multi-Level-Optimization Framework for FPGA-Based Cellular Neural Network Implementation.

FPGA based cellular neural network optimization: from design space to system.

Towards Enabling Dynamic Convolution Neural Network Inference for Edge Intelligence

Optimizing Neural Network Inference in Edge Robotics by Harnessing FPGA Hardware Acceleration

Genetic Algorithm Augmented Inception-Net based Image Classifier Accelerated on FPGA

Accuracy vs. Efficiency: Achieving Both through FPGA-Implementation Aware Neural Architecture Search

Toward Fast Platform-Aware Neural Architecture Search for FPGA-Accelerated Edge AI Applications

Efficient Neural Networks on the Edge with FPGAs by Optimizing an Adaptive Activation Function

Customizing Neural Networks for Efficient FPGA Implementation

An Fpga-Based Dynamic Reconfigurable Cnn Edge Computing Device for Object Classification

Fpga-based SoC design for real-time facial point detection using deep convolutional neural networks with dynamic partial reconfiguration

A Novel Design of Adaptive and Hierarchical Convolutional Neural Networks using Partial Reconfiguration on FPGA

Neuroevolving Electronic Dynamical Networks

An Efficient FPGA-Based Convolutional Neural Network for Classification: Ad-MobileNet

A Power Efficient Neural Network Implementation on Heterogeneous FPGA and GPU Devices

Deep neural network accelerator based on FPGA

Design and Implementation of an FPGA-Based DNN Architecture for Real-time Outlier Detection

An FPGA-Based Neural Network Overlay for ADAS Supporting Multi-Model and Multi-Mode

Improving HW/SW Adaptability for Accelerating CNNs on FPGAs Through A Dynamic/Static Co-Reconfiguration Approach

AdaptiveNet: Post-deployment Neural Architecture Adaptation for Diverse Edge Environments