Abstract:Convolutional Neural Networks (CNNs) have been widely applied in various fields, such as image recognition, speech processing, as well as in many big-data analysis tasks. However, their large size and intensive computation hinder their deployment in hardware, especially on the embedded systems with stringent latency, power, and area requirements. To address this issue, low bit-width CNNs are proposed as a highly competitive candidate. In this paper, we propose an efficient, scalable accelerator for low bit-width CNNs based on a parallel streaming architecture. With a novel coarse grain task partitioning (CGTP) strategy, the proposed accelerator with heterogeneous computing units, supporting multi-pattern dataflows, can nearly double the throughput for various CNN models on average. Besides, a hardware-friendly algorithm is proposed to simplify the activation and quantification process, which can reduce the power dissipation and area overhead. Based on the optimized algorithm, an efficient reconfigurable three-stage activation-quantification-pooling (AQP) unit with the low power staged blocking strategy is developed, which can process activation, quantification, and max-pooling operations simultaneously. Moreover, an interleaving memory scheduling scheme is proposed to well support the streaming architecture. The accelerator is implemented with TSMC 40 nm technology with a core size of 0.17 mm 2 . It can achieve 7.03 TOPS/W energy efficiency and 4.14 TOPS/mm 2 area efficiency at 100.1 mW, which makes it a promising design for the embedded devices.

A Review of Convolutional Neural Networks Hardware Accelerators for AIoT Edge Computing

A Convolutional Neural Network Accelerator Architecture with Fine-Granular Mixed Precision Configurability.

A Survey on Efficient Convolutional Neural Networks and Hardware Acceleration

A High Efficient Architecture for Convolution Neural Network Accelerator

A high-speed reusable quantized hardware accelerator design for CNN on constrained edge device

A Reconfigurable Streaming Deep Convolutional Neural Network Accelerator for Internet of Things

Optimizing of Convolutional Neural Network Accelerator

A High-Efficient and Configurable Hardware Accelerator for Convolutional Neural Network

Survey of convolutional neural network accelerators on field-programmable gate array platforms: architectures and optimization techniques

A review of AI edge devices and lightweight CNN deployment

An Efficient Lightweight CNN Acceleration Architecture for Edge Computing Based-on FPGA

Low-Power Ultra-Small Edge AI Accelerators for Image Recognition with Convolution Neural Networks: Analysis and Future Directions

A Parallel Loading Based Accelerator for Convolution Neural Network

Convolutional Neural Network Accelerator Architecture Design for Ultimate Edge Computing Scenario

An Area-Efficient CNN Accelerator Supporting Global Average Pooling with Arbitrary Shapes

A Low-Power Hardware Architecture for Real-Time CNN Computing

Efficient Hardware Optimization Strategies For Deep Neural Networks Acceleration Chip

A Comprehensive Analysis of Deployment Optimization Methods for CNN-Based Applications on Edge Devices

An NoC-based CNN Accelerator for Edge Computing

An Efficient Streaming Accelerator for Low Bit-Width Convolutional Neural Networks

High Performance Convolutional Neural Network Accelerator Based on Design Space Exploration