Abstract:In this paper, we propose a compact and low-power mixed-signal approach to implementing convolutional operators that are often responsible for most of the chip area and power consumption of Convolutional Neural Network (CNN) processing chips. The convolutional operators consist of several multiply-and-accumulate (MAC) units. MAC units are the primary components that process convolutional layers and fully connected layers of CNN models. Analog implementation of MAC units opens a new paradigm for realizing low-power CNN processing chips, benefiting from less power and area consumption. The proposed mixed-signal convolutional operator comprises low-power binary-weighted current steering digital-to-analog conversion (DAC) circuits and accumulation capacitors. Compared with a conventional binary-weighted DAC, the proposed circuit benefits from optimum accuracy, smaller area, and lower power consumption due to its symmetric design. The proposed convolutional operator takes as input a set of 9-bit digital input feature data and weight parameters of the convolutional filter. It then calculates the convolutional filter's result and accumulates the resulting voltage on capacitors. In addition, the convolutional operator employs a novel charge-sharing technique to process negative MAC results. We propose an analog max-pooling circuit that instantly selects the maximum input voltage. To demonstrate the performance of the proposed mixed-signal convolutional operator, we implemented a CNN processing chip consisting of 3 analog convolutional operators, with each operator processing a 3 × 3 kernel. This chip contains 27 MAC circuits, an analog max-pooling, and an analog-to-digital conversion (ADC) circuit. The mixed-signal CNN processing chip is implemented using a CMOS 55 nm process, which occupies a silicon area of 0.0559 mm2 and consumes an average power of 540.6 μW. The proposed mixed-signal CNN processing chip offers an area reduction of 84.21% and an energy reduction of 91.85% compared with a conventional digital CNN processing chip. Moreover, another CNN processing chip is implemented with more analog convolutional operators to demonstrate the operation and structure of an example convolutional layer of a CNN model. Therefore, the proposed analog convolutional operator can be adapted in various CNN models as an alternative to digital counterparts.

A Low-Power Processing Element Based on Asynchronous Data-Driven Bit-Serial Multiplier for CNNs

A Convolutional Neural Network Accelerator Architecture with Fine-Granular Mixed Precision Configurability.

Power Efficient Tiny Yolo CNN Using Reduced Hardware Resources Based on Booth Multiplier and WALLACE Tree Adders

A Low-Power Hardware Architecture for Real-Time CNN Computing

An Asynchronous and Reconfigurable CNN Accelerator

Smilodon: an Efficient Accelerator for Low Bit-Width CNNs with Task Partitioning

An Energy-Efficient Convolutional Neural Network Processor Architecture Based on a Systolic Array

CNN hardware acceleration on a low-power and low-cost APSoC

Design and Tool Flow of a Reconfigurable Asynchronous Neural Network Accelerator

A high-speed reusable quantized hardware accelerator design for CNN on constrained edge device

An Asynchronous Energy-Efficient CNN Accelerator with Reconfigurable Architecture.

A Low-Power Sparse Convolutional Neural Network Accelerator with Pre-Encoding Radix-4 Booth Multiplier

PPBAM:A Preprocessing-based Power-Efficient Approximate Multiplier Design for CNN

A Data-Driven Asynchronous Neural Network Accelerator

An Efficient Streaming Accelerator for Low Bit-Width Convolutional Neural Networks

YodaNN: An Ultra-Low Power Convolutional Neural Network Accelerator Based on Binary Weights

Communication-Aware and Resource-Efficient NoC-Based Architecture for CNN Acceleration

A-DSCNN: Depthwise Separable Convolutional Neural Network Inference Chip Design Using an Approximate Multiplier

A Power-Efficient Accelerator for Convolutional Neural Networks

AdaS: A Fast and Energy-Efficient CNN Accelerator Exploiting Bit-Sparsity

Analog Convolutional Operator Circuit for Low-Power Mixed-Signal CNN Processing Chip