Abstract:In this paper, we propose a compact and low-power mixed-signal approach to implementing convolutional operators that are often responsible for most of the chip area and power consumption of Convolutional Neural Network (CNN) processing chips. The convolutional operators consist of several multiply-and-accumulate (MAC) units. MAC units are the primary components that process convolutional layers and fully connected layers of CNN models. Analog implementation of MAC units opens a new paradigm for realizing low-power CNN processing chips, benefiting from less power and area consumption. The proposed mixed-signal convolutional operator comprises low-power binary-weighted current steering digital-to-analog conversion (DAC) circuits and accumulation capacitors. Compared with a conventional binary-weighted DAC, the proposed circuit benefits from optimum accuracy, smaller area, and lower power consumption due to its symmetric design. The proposed convolutional operator takes as input a set of 9-bit digital input feature data and weight parameters of the convolutional filter. It then calculates the convolutional filter's result and accumulates the resulting voltage on capacitors. In addition, the convolutional operator employs a novel charge-sharing technique to process negative MAC results. We propose an analog max-pooling circuit that instantly selects the maximum input voltage. To demonstrate the performance of the proposed mixed-signal convolutional operator, we implemented a CNN processing chip consisting of 3 analog convolutional operators, with each operator processing a 3 × 3 kernel. This chip contains 27 MAC circuits, an analog max-pooling, and an analog-to-digital conversion (ADC) circuit. The mixed-signal CNN processing chip is implemented using a CMOS 55 nm process, which occupies a silicon area of 0.0559 mm2 and consumes an average power of 540.6 μW. The proposed mixed-signal CNN processing chip offers an area reduction of 84.21% and an energy reduction of 91.85% compared with a conventional digital CNN processing chip. Moreover, another CNN processing chip is implemented with more analog convolutional operators to demonstrate the operation and structure of an example convolutional layer of a CNN model. Therefore, the proposed analog convolutional operator can be adapted in various CNN models as an alternative to digital counterparts.

AICNN: Implementing Typical CNN Algorithms with Analog-to-Information Conversion Architecture

A Convolutional Neural Network Accelerator Architecture with Fine-Granular Mixed Precision Configurability.

DaDianNao: A Machine-Learning Supercomputer

Analog Convolutional Operator Circuit for Low-Power Mixed-Signal CNN Processing Chip

AnalogNet: Convolutional Neural Network Inference on Analog Focal Plane Sensor Processors

Analog Deep Neural Network Based On Nor Flash Computing Array For High Speed/Energy Efficiency Computation

Low power Convolutional Neural Networks on a chip

A Proposal for Energy-Efficient Cellular Neural Network based on Spintronic Devices

A Low-Power Hardware Architecture for Real-Time CNN Computing

An Energy-Efficient Architecture for Binary Weight Convolutional Neural Networks

An Analog-Memoryless Near Sensor Computing Architecture for Always-On Intelligent Perception Applications

An Energy-Efficient Systolic Pipeline Architecture for Binary Convolutional Neural Network.

Efficient Hardware Architectures for Deep Convolutional Neural Network

A high-speed reusable quantized hardware accelerator design for CNN on constrained edge device

Improving the accuracy of neural networks in analog computing-in-memory systems by analog weight.

A High Efficient Architecture for Convolution Neural Network Accelerator

A Hybrid Precision Low Power Computing-in-memory Architecture for Neural Networks

UACT: A Unified Energy-efficient Computing Architecture for CNN and TCNN.

A Time-Domain Binary CNN Engine with Error-Detection-Based Resilience in 28nm CMOS

Processing Near Sensor Architecture in Mixed-Signal Domain with CMOS Image Sensor of Convolutional-Kernel-Readout Method