Abstract:In recent years FPGA has become popular in CNN acceleration, and many CNN-to-FPGA toolchains are proposed to fast deploy CNN on FPGA. However, for these toolchains, updating CNN network means regeneration of RTL code and re-implementation which is time-consuming and may suffer timing-closure problems. So, we propose HBDCA: a toolchain and corresponding accelerator. The CNN on HBDCA is defined by the content of BRAM. The toolchain integrates UpdateMEM utility of Xilinx, which updates content of BRAM without re-synthesis and re-implementation process. The toolchain also integrates TensorFlow Lite which provides high-accuracy quantization. HBDCA supports 8-bits per-channel quantization of weights and 8-bits per-layer quantization of activations. Upgrading CNN on accelerator means the kernel size of CNN may change. Flexible structure of HBDCA supports kernel-level parallelism with three different sizes (3×3, 5×5, 7×7). HBDCA implements four types of parallelism in convolution layer and two types of parallelism in fully-connected layer. In order to reduce access number to memory, both spatial and temporal data-reuse techniques were applied on convolution layer and fully-connect layer. Especially, temporal reuse is adopted at both row and column level of an Input Feature Map of convolution layer. Data can be just read once from BRAM and reused for the following clock. Experiments show by updating BRAM content with single UpdateMEM command, three CNNs with different kernel size (3×3, 5×5, 7×7) are implemented on HBDCA. Compared with traditional design flow, UpdateMEM reduces development time by 7.6X-9.1X for different synthesis or implementation strategy. For similar CNN which is created by toolchain, HBDCA has smaller latency (9.97µs-50.73µs), and eliminates re-implementation when update CNN. For similar CNN which is created by dedicated design, HBDCA also has the smallest latency 9.97µs, the highest accuracy 99.14% and the lowest power 1.391W. For different CNN which is created by similar toolchain which eliminate re-implementation process, HBDCA achieves higher speedup 120.28X.

CFEACT: A CGRA-based Framework Enabling Agile CNN and Transformer Accelerator Design

A Convolutional Neural Network Accelerator Architecture with Fine-Granular Mixed Precision Configurability.

FastCGRA: A Modeling, Evaluation, and Exploration Platform for Large-Scale Coarse-Grained Reconfigurable Arrays

Improving HW/SW Adaptability for Accelerating CNNs on FPGAs Through A Dynamic/Static Co-Reconfiguration Approach

A CGRA Front-end Compiler Enabling Extraction of General Control and Dedicated Operators

Improving the computational efficiency and flexibility of FPGA-based CNN accelerator through loop optimization

A flexible FPGA accelerator for convolutional neural networks

A Compiler Design for a Programmable CNN Accelerator

Design of a Generic Dynamically Reconfigurable Convolutional Neural Network Accelerator with Optimal Balance

A Flexible and Energy-Efficient Convolutional Neural Network Acceleration with Dedicated ISA and Accelerator

A Flexible and Efficient FPGA Accelerator for Various Large-Scale and Lightweight CNNs

A General-Purpose Compiler Design for Instruction-Based AI Accelerator Implementation.

Optimizing FPGA-based Accelerator Design for Deep Convolutional Neural Networks

Flare: An FPGA-Based Full Precision Low Power CNN Accelerator with Reconfigurable Structure

MDCRA: A Reconfigurable Accelerator Framework for Multiple Dataflow Lanes

ALSCA: A Large-Scale Sparse CNN Accelerator Using Position-First Dataflow and Input Channel Merging Approach

HBDCA: A Toolchain for High-Accuracy BRAM-Defined CNN Accelerator on FPGA with Flexible Structure

CAT: Customized Transformer Accelerator Framework on Versal ACAP

A High Efficient Architecture for Convolution Neural Network Accelerator

CASCADE: A Framework for CNN Accelerator Synthesis with Concatenation and Refreshing Dataflow

DT-CGRA: Dual-track Coarse-Grained Reconfigurable Architecture for Stream Applications