Abstract:<p>Over the past few years, Convolution Neural Networks (CNN) have been extensively adopted in broad AI applications and have achieved noticeable effect. Deploying the feedforward inference of CNN on edge devices has now been considered a research hotspot in Edge Computing. In terms of the mobile embedded devices that exhibit constrained resources and power budget, the considerable parameters and computational bottlenecks raised rigorous requirements of deploying the CNN feedforward inference. To address this challenge, the present study develops a lightweight neural network architecture termed as SparkNet, capable of significantly reducing the weight parameters and computation demands. The feasibility of the SparkNet is verified on four datasets, i.e., MINIST, CIFAR-10, CIFAR-100 and SVHN. Besides, the SparkNet is reported exhibiting the ability to effectively compress the convolutional neural network by a factor of 150x. Compared with GPU and ASIC, an FPGA-based accelerator exhibits obvious advantages for its reconfigurable property, flexibility, power efficiency, as well as massive parallelism. Moreover, the network model of the SparkNet and the proposed accelerator architecture are both specifically built for FPGA. The SparkNet on chip (SparkNOC) that maps all the layers of the network to their own dedicated hardware unit for simultaneous pipelined work has been implemented on FPGA. The proposals of this study are assessed by deploying SparkNet model on Intel Arria 10 GX1150 FPGA platform. As revealed from the experimental results, the fully pipelined CNN hardware accelerator achieves 337.2 GOP/s performance under the energy efficiency of 44.48 GOP/s/w, indicating that it outperforms the previous methods.</p>

Accelerating Mobile Applications at the Network Edge with Software-Programmable FPGAs.

The Case for FPGA-Based Edge Computing

Live Video Analytics with FPGA-based Smart Cameras

High-performance Subpixel Edge Location Based on FPGA for Horizon Sensors

An SSD-MobileNet Acceleration Strategy for FPGAs Based on Network Compression and Subgraph Fusion

Are FPGAs Suitable for Edge Computing?

Efficient Edge AI: Deploying Convolutional Neural Networks on FPGA with the Gemmini Accelerator

SparkNoC: An energy-efficiency FPGA-based accelerator using optimized lightweight CNN for edge computing

Mobile or FPGA? A Comprehensive Evaluation on Energy Efficiency and a Unified Optimization Framework

Towards An FPGA-targeted Hardware/Software Co-design Framework for CNN-based Edge Computing

A High-Performance Accelerator for Real-Time Super-Resolution on Edge FPGAs

Research on Convolutional Neural Network Inference Acceleration and Performance Optimization for Edge Intelligence

New paradigm of FPGA-based computational intelligence from surveying the implementation of DNN accelerators

Enabling FPGAs in the cloud.

Optimizing Neural Network Inference in Edge Robotics by Harnessing FPGA Hardware Acceleration

Challenges in Energy-Efficient Deep Neural Network Training with FPGA.

Heterogeneous FPGA+GPU Embedded Systems: Challenges and Opportunities

A Data-Center FPGA Acceleration Platform for Convolutional Neural Networks

A Ubiquitous Machine Learning Accelerator With Automatic Parallelization on FPGA

Toward Full-Stack Acceleration of Deep Convolutional Neural Networks on FPGAs

Sustainable AI Processing at the Edge