Abstract:In this paper, we propose a compact and low-power mixed-signal approach to implementing convolutional operators that are often responsible for most of the chip area and power consumption of Convolutional Neural Network (CNN) processing chips. The convolutional operators consist of several multiply-and-accumulate (MAC) units. MAC units are the primary components that process convolutional layers and fully connected layers of CNN models. Analog implementation of MAC units opens a new paradigm for realizing low-power CNN processing chips, benefiting from less power and area consumption. The proposed mixed-signal convolutional operator comprises low-power binary-weighted current steering digital-to-analog conversion (DAC) circuits and accumulation capacitors. Compared with a conventional binary-weighted DAC, the proposed circuit benefits from optimum accuracy, smaller area, and lower power consumption due to its symmetric design. The proposed convolutional operator takes as input a set of 9-bit digital input feature data and weight parameters of the convolutional filter. It then calculates the convolutional filter's result and accumulates the resulting voltage on capacitors. In addition, the convolutional operator employs a novel charge-sharing technique to process negative MAC results. We propose an analog max-pooling circuit that instantly selects the maximum input voltage. To demonstrate the performance of the proposed mixed-signal convolutional operator, we implemented a CNN processing chip consisting of 3 analog convolutional operators, with each operator processing a 3 × 3 kernel. This chip contains 27 MAC circuits, an analog max-pooling, and an analog-to-digital conversion (ADC) circuit. The mixed-signal CNN processing chip is implemented using a CMOS 55 nm process, which occupies a silicon area of 0.0559 mm2 and consumes an average power of 540.6 μW. The proposed mixed-signal CNN processing chip offers an area reduction of 84.21% and an energy reduction of 91.85% compared with a conventional digital CNN processing chip. Moreover, another CNN processing chip is implemented with more analog convolutional operators to demonstrate the operation and structure of an example convolutional layer of a CNN model. Therefore, the proposed analog convolutional operator can be adapted in various CNN models as an alternative to digital counterparts.

A novel OTA for implementing programmable CNN

A Novel Multiplier For Achieving The Programmability Of Cellular Neural Network

A Reconfigurable Approximate Multiplier for Quantized CNN Applications.

A Convolutional Neural Network Accelerator Architecture with Fine-Granular Mixed Precision Configurability.

A Proposal for Energy-Efficient Cellular Neural Network based on Spintronic Devices

Optical-electronic Hybrid Fourier Convolutional Neural Network Based on Super-Pixel Complex-Valued Modulation

AICNN: Implementing Typical CNN Algorithms with Analog-to-Information Conversion Architecture

Analog Convolutional Operator Circuit for Low-Power Mixed-Signal CNN Processing Chip

Design Of Four-Wave Oscillating Cellular-Neural-Network

High-Speed CNN Accelerator SoC Design Based on a Flexible Diagonal Cyclic Array

High-accuracy optical convolution unit architecture for convolutional neural networks by cascaded acousto-optical modulator arrays

An Energy-and-Area-Efficient CNN Accelerator for Universal Powers-of-Two Quantization.

A Configurable and Fully Synthesizable RTL-Based Convolutional Neural Network for Biosensor Applications

An Efficient Streaming Accelerator for Low Bit-Width Convolutional Neural Networks

An Analog Neural Network Computing Engine using CMOS-Compatible Charge-Trap-Transistor (CTT)

OMNI: A Framework for Integrating Hardware and Software Optimizations for Sparse CNNs

A high-speed reusable quantized hardware accelerator design for CNN on constrained edge device

Low-precision deep-learning-based automatic modulation recognition system

UNIVERSAL CNN CELLS

Quantization-Based Optimization Algorithm for Hardware Implementation of Convolution Neural Networks

Memristor-Based Cellular Nonlinear/Neural Network: Design, Analysis, and Applications