Abstract:<p>Over the past few years, Convolution Neural Networks (CNN) have been extensively adopted in broad AI applications and have achieved noticeable effect. Deploying the feedforward inference of CNN on edge devices has now been considered a research hotspot in Edge Computing. In terms of the mobile embedded devices that exhibit constrained resources and power budget, the considerable parameters and computational bottlenecks raised rigorous requirements of deploying the CNN feedforward inference. To address this challenge, the present study develops a lightweight neural network architecture termed as SparkNet, capable of significantly reducing the weight parameters and computation demands. The feasibility of the SparkNet is verified on four datasets, i.e., MINIST, CIFAR-10, CIFAR-100 and SVHN. Besides, the SparkNet is reported exhibiting the ability to effectively compress the convolutional neural network by a factor of 150x. Compared with GPU and ASIC, an FPGA-based accelerator exhibits obvious advantages for its reconfigurable property, flexibility, power efficiency, as well as massive parallelism. Moreover, the network model of the SparkNet and the proposed accelerator architecture are both specifically built for FPGA. The SparkNet on chip (SparkNOC) that maps all the layers of the network to their own dedicated hardware unit for simultaneous pipelined work has been implemented on FPGA. The proposals of this study are assessed by deploying SparkNet model on Intel Arria 10 GX1150 FPGA platform. As revealed from the experimental results, the fully pipelined CNN hardware accelerator achieves 337.2 GOP/s performance under the energy efficiency of 44.48 GOP/s/w, indicating that it outperforms the previous methods.</p>

Convolutional Neural Networks on the Edge: A Comparison Between FPGA and GPU

Efficient Edge AI: Deploying Convolutional Neural Networks on FPGA with the Gemmini Accelerator

Convolutional Neural Network Construction Method for Embedded FPGAs Oriented Edge Computing

A Data-Center FPGA Acceleration Platform for Convolutional Neural Networks

Hardware Resource and Computational Density Efficient CNN Accelerator Design Based on FPGA

The Case for FPGA-Based Edge Computing

A comparative study of FPGA and CGRA technologies in hardware acceleration for deep learning

A Review of FPGA-Based Custom Computing Architecture for Convolutional Neural Network Inference

Optimizing Neural Network Inference in Edge Robotics by Harnessing FPGA Hardware Acceleration

Research on Convolutional Neural Network Inference Acceleration and Performance Optimization for Edge Intelligence

Survey of convolutional neural network accelerators on field-programmable gate array platforms: architectures and optimization techniques

Resource and Data Optimization for Hardware Implementation of Deep Neural Networks Targeting FPGA-based Edge Devices.

Towards An FPGA-targeted Hardware/Software Co-design Framework for CNN-based Edge Computing

SparkNoC: An energy-efficiency FPGA-based accelerator using optimized lightweight CNN for edge computing

Toward Full-Stack Acceleration of Deep Convolutional Neural Networks on FPGAs

Accelerating CNN inference on FPGAs: A Survey

Exploring Heterogeneous Algorithms for Accelerating Deep Convolutional Neural Networks on FPGAs

An Efficient Lightweight CNN Acceleration Architecture for Edge Computing Based-on FPGA

EdgeNN: Efficient Neural Network Inference for CPU-GPU Integrated Edge Devices.

Caffeinated FPGAs: FPGA Framework For Convolutional Neural Networks

Challenges in Energy-Efficient Deep Neural Network Training with FPGA.