Abstract:In this paper, we propose a compact and low-power mixed-signal approach to implementing convolutional operators that are often responsible for most of the chip area and power consumption of Convolutional Neural Network (CNN) processing chips. The convolutional operators consist of several multiply-and-accumulate (MAC) units. MAC units are the primary components that process convolutional layers and fully connected layers of CNN models. Analog implementation of MAC units opens a new paradigm for realizing low-power CNN processing chips, benefiting from less power and area consumption. The proposed mixed-signal convolutional operator comprises low-power binary-weighted current steering digital-to-analog conversion (DAC) circuits and accumulation capacitors. Compared with a conventional binary-weighted DAC, the proposed circuit benefits from optimum accuracy, smaller area, and lower power consumption due to its symmetric design. The proposed convolutional operator takes as input a set of 9-bit digital input feature data and weight parameters of the convolutional filter. It then calculates the convolutional filter's result and accumulates the resulting voltage on capacitors. In addition, the convolutional operator employs a novel charge-sharing technique to process negative MAC results. We propose an analog max-pooling circuit that instantly selects the maximum input voltage. To demonstrate the performance of the proposed mixed-signal convolutional operator, we implemented a CNN processing chip consisting of 3 analog convolutional operators, with each operator processing a 3 × 3 kernel. This chip contains 27 MAC circuits, an analog max-pooling, and an analog-to-digital conversion (ADC) circuit. The mixed-signal CNN processing chip is implemented using a CMOS 55 nm process, which occupies a silicon area of 0.0559 mm2 and consumes an average power of 540.6 μW. The proposed mixed-signal CNN processing chip offers an area reduction of 84.21% and an energy reduction of 91.85% compared with a conventional digital CNN processing chip. Moreover, another CNN processing chip is implemented with more analog convolutional operators to demonstrate the operation and structure of an example convolutional layer of a CNN model. Therefore, the proposed analog convolutional operator can be adapted in various CNN models as an alternative to digital counterparts.

A Novel Multiplier For Achieving The Programmability Of Cellular Neural Network

A Reconfigurable Approximate Multiplier for Quantized CNN Applications.

A novel OTA for implementing programmable CNN

A Reconfigurable Multiplier for Signed Multiplications with Asymmetric Bit-Widths.

A Convolutional Neural Network Accelerator Architecture with Fine-Granular Mixed Precision Configurability.

A Multi-Level-Optimization Framework for FPGA-Based Cellular Neural Network Implementation.

A Proposal for Energy-Efficient Cellular Neural Network based on Spintronic Devices

Design of a new CMOS Low-Power Analogue Neuron

Analog Convolutional Operator Circuit for Low-Power Mixed-Signal CNN Processing Chip

A-DSCNN: Depthwise Separable Convolutional Neural Network Inference Chip Design Using an Approximate Multiplier

Memristor-Based Cellular Nonlinear/Neural Network: Design, Analysis, and Applications

A low power high bandwidth four quadrant analog multiplier in 32 nm CNFET technology

An Analog Neural Network Computing Engine using CMOS-Compatible Charge-Trap-Transistor (CTT)

An 11T1C Bit-Level-Sparsity-Aware Computing-in-Memory Macro with Adaptive Conversion Time and Computation Voltage

A Computing In-Memory Multibit Multiplication Based on Decoupling and In-Array Storing

An energy efficient radix-4 Booth encoding parallel multiplier design

AICNN: Implementing Typical CNN Algorithms with Analog-to-Information Conversion Architecture

Circuit Design of a Novel Analog Multiplier

Linear Delay-cell Design for Low-energy Delay Multiplication and Accumulation

Improving the accuracy of neural networks in analog computing-in-memory systems by analog weight.

Programmable synapse analog CMOS neural network