Abstract:Convolutional neural network (CNN) hardware acceleration is critical to improve the performance and facilitate the deployment of CNNs in edge applications. Due to its efficiency and simplicity, channel group parallelism has become a popular method for CNN hardware acceleration. However, when processing data involving small channels, there will be a mismatch between feature data and computing units, resulting in a low utilization of the computing units. When processing the middle layer of the convolutional neural network, the mismatch between the feature-usage order and the feature-loading order leads to a low input feature cache hit rate. To address these challenges, this paper proposes an innovative method inspired by data reordering technology, aiming to achieve CNN hardware acceleration that reuses the same multiplier resources. This method focuses on transforming the hardware acceleration process into feature organization, feature block scheduling and allocation, and feature calculation subtasks to ensure the efficient mapping of continuous loading and the calculation of feature data. Specifically, this paper introduces a convolutional algorithm mapping strategy and a configurable vector operation unit to enhance multiplier utilization for different feature map sizes and channel numbers. In addition, an off-chip address mapping and on-chip cache management mechanism is proposed to effectively improve the feature access efficiency and on-chip feature cache hit rate. Furthermore, a configurable feature block scheduling policy is proposed to strike a balance between weight reuse and feature writeback pressure. Experimental results demonstrate the effectiveness of this method. When using 512 multipliers and accelerating VGG16 at 100 MHz, the actual computing performance reaches 102.3 giga operations per second (GOPS). Compared with other CNN hardware acceleration methods, the average computing array utilization is as high as 99.88% and the computing density is higher.

Configurable CNN Accelerator Based on Tiling Dataflow

A Convolutional Neural Network Accelerator Architecture with Fine-Granular Mixed Precision Configurability.

Single-Channel Dataflow for Convolutional Neural Network Accelerator

A High-Performance Reconfigurable Accelerator for Convolutional Neural Networks.

Optimizing CNN Hardware Acceleration with Configurable Vector Units and Feature Layout Strategies

An Efficient Streaming Accelerator for Low Bit-Width Convolutional Neural Networks

A High-Efficient and Configurable Hardware Accelerator for Convolutional Neural Network

A Flexible and Efficient FPGA Accelerator for Various Large-Scale and Lightweight CNNs

ACCDSE: A Design Space Exploration Framework for Convolutional Neural Network Accelerator.

An Efficient CNN Accelerator Achieving High PE Utilization Using a Dense-/Sparse-Aware Redundancy Reduction Method and Data–Index Decoupling Workflow

A High Efficient Architecture for Convolution Neural Network Accelerator

Design of a Generic Dynamically Reconfigurable Convolutional Neural Network Accelerator with Optimal Balance

A 681 GOPS/W~3.59 TOPS/W CNN Accelerator Based on Novel Data Flow Scheduling Scheme

An Area-Efficient CNN Accelerator Supporting Global Average Pooling with Arbitrary Shapes

A Parallel Loading Based Accelerator for Convolution Neural Network

Eyelet: A Cross-Mesh NoC-Based Fine-Grained Sparse CNN Accelerator for Spatio-Temporal Parallel Computing Optimization

Layer-Wise Mixed-Modes CNN Processing Architecture With Double-Stationary Dataflow and Dimension-Reshape Strategy

An Efficient and Flexible Accelerator Design for Sparse Convolutional Neural Networks

A Reconfigurable CNN Accelerator Using Tile-by-Tile Computing and Dynamic Adaptive Data Truncation

Flexible and Efficient Convolutional Acceleration on Unified Hardware Using the Two-Stage Splitting Method and Layer-Adaptive Allocation of 1-D/2-D Winograd Units

A Compiler Design for a Programmable CNN Accelerator