Abstract:This paper introduces a 16‐bit fixed‐point field‐programmable gate array (FPGA)‐based hardware accelerator for deep learning on a 32‐bit low‐memory edge device (PYNQ‐Z2 board). Singular value decomposition (SVD) optimizes the fully connected layer. The accelerator unit spans all five layers, leveraging eight processing elements for parallel computations in convolution layers 1 and 2. Techniques like array partitioning, loop unrolling, and pipelining enhance computation speed. The accelerator outperforms software‐based implementations by 89.03%, 86.12%, and 82.45% against INTEL 3‐core CPU, Haswell 2‐core CPU, and NVIDIA Tesla K80 GPU, respectively. Convolutional neural networks (CNNs) are now often used in deep learning and computer vision applications. Its convolutional layer accounts for most calculations and should be computed fast in a local edge device. Field‐programmable gate arrays (FPGAs) have been adequately explored as promising hardware accelerators for CNNs due to their high performance, energy efficiency, and reconfigurability. This paper developed an efficient FPGA‐based 16‐bit fixed‐point hardware accelerator unit for deep learning applications on the 32‐bit low‐memory edge device (PYNQ‐Z2 board). Additionally, singular value decomposition is applied to the fully connected layer for dimensionality reduction of weight parameters. The accelerator unit was designed for all five layers and employed eight processing elements in convolution layers 1 and 2 for parallel computations. In addition, array partitioning, loop unrolling, and pipelining are the techniques used to increase the speed of calculations. The AXI‐Lite interface was also used to communicate between IP and other blocks. Moreover, the design is tested with grayscale image classification on MNIST handwritten digit dataset and color image classification on the Tumor dataset. The experimental results show that the proposed accelerator unit implementation performs faster than the software‐based implementation. Its inference speed is 89.03% more than INTEL 3‐core CPU, 86.12% higher than Haswell 2‐core CPU, and 82.45% more than NVIDIA Tesla K80 GPU. Furthermore, the throughput of the proposed design is 4.33GOP/s, which is better than the conventional CNN accelerator architectures.

A Low Latency Kernel Recursive Least Squares Processor Using FPGA Technology

Scalable SVM Processor and Its Application to Nonlinear Channel Equalization

The implementation of a Deep Recurrent Neural Network Language Model on a Xilinx FPGA

A Ubiquitous Machine Learning Accelerator With Automatic Parallelization on FPGA

Optimizing the Performance of the Sparse Matrix-Vector Multiplication Kernel in FPGA Guided by the Roofline Model

RAPID: AppRoximAte Pipelined Soft Multipliers and Dividers for High-Throughput and Energy-Efficiency

A Novel Hybrid Fast Fourier Transform Processor in 5G+ and Bio Medical Applications

Towards Power Efficient DNN Accelerator Design on Reconfigurable Platform

Implementation of a framework for deploying AI inference engines in FPGAs

THE DESIGN OF THE PIPELINED RISC-V PROCESSOR WITH THE HARDWARE COPROCESSOR OF DIGITAL SIGNAL PROCESSING

Multiplierless MP-Kernel Machine for Energy-Efficient Edge Devices

AddNet: Deep Neural Networks Using FPGA-Optimized Multipliers

Fast and Low-Cost Approximate Multiplier for FPGAs using Dynamic Reconfiguration

Laius: An 8-Bit Fixed-Point CNN Hardware Inference Engine

A Software-Hardware Collaboration System for CNN Algorithms Based on FPGA

Reduced-Precision Floating-Point Arithmetic in Systolic Arrays with Skewed Pipelines

RSNN: A Software/Hardware Co-Optimized Framework for Sparse Convolutional Neural Networks on FPGAs

Empowering edge devices: FPGA‐based 16‐bit fixed‐point accelerator with SVD for CNN on 32‐bit memory‐limited systems

Improved optical sintering efficiency at the contacts of silver nanowires encapsulated by a graphene layer.

Reuse Kernels or Activations? A Flexible Dataflow for Low-latency Spectral CNN Acceleration

Accelerating Neural-ODE Inference on FPGAs with Two-Stage Structured Pruning and History-based Stepsize Search.