Abstract:The novel Computing-In-Memory (CIM) technology has demonstrated significant potential in enhancing the performance and efficiency of convolutional neural networks (CNNs). However, due to the low precision of memory devices and data interfaces, an additional quantization step is necessary. Conventional NN quantization methods fail to account for the hardware characteristics of CIM, resulting in inferior system performance and efficiency. This paper proposes CIMQ, a hardware-efficient quantization framework designed to improve the efficiency of CIM based NN accelerators. The holistic framework focuses on the fundamental computing elements in CIM hardware: inputs, weights and outputs (or activations, weights and partial sums in NNs) with four innovative techniques. Firstly, bit-level sparsity induced activation quantization is introduced to decrease dynamic computation energy. Secondly, inspired by the unique computation paradigm of CIM, an innovative array-wise quantization granularity is proposed for weight quantization. Thirdly, partial sums are quantized with a reparametrized clipping function to reduce the required resolution of analog-to-digital converters (ADCs). Finally, to improve the accuracy of quantized neural networks (QNNs), the post-training quantization (PTQ) is enhanced with a random quantization dropping strategy. The effectiveness of the proposed framework has been demonstrated through experimental results on various NNs and datasets (CIFAR10, CIFAR100, ImageNet). In typical cases, the hardware efficiency can be improved up to 222% with a 58.97% improvement in accuracy compared to conventional quantization methods.

An In-Memory-Computing Structure with Quantum-Dot Transistor Toward Neural Network Applications: From Analog Circuits to Memory Arrays

An Overview of Computing-in-Memory Interfaces

Computing-in-memory Circuits and Cross-Layer Integrated Design and Optimization: from SRAM to FeFET

A Brain-Inspired In-Memory Computing System for Neuronal Communication Via Memristive Circuits.

An in-memory computing architecture based on two-dimensional semiconductors for multiply-accumulate operations

In-memory Computing with Emerging Nonvolatile Memory Devices

In-Memory Computing: Advances and Prospects

CIMQ: A Hardware-Efficient Quantization Framework for Computing-In-Memory Based Neural Network Accelerators

Design and Implementation of a Charge-Sharing In-Memory-computing Macro with Sparse Feature for Quantized Neural Network

Integrated In-Memory Sensor and Computing of Artificial Vision System Based on Reversible Bonding Transition-Induced Nitrogen-Doped Carbon Quantum Dots (N-Cqds)

In-Memory Computing: The Next-Generation AI Computing Paradigm

Emerging Memory Devices for Neuromorphic Computing

In-memory Computing to Break the Memory Wall

An in-memory computing architecture based on a duplex 2D material structure for in-situ machine learning

A Novel Computing-in-Memory Platform Based on Hybrid Spintronic/CMOS Memory

Quantum Memory: A Missing Piece in Quantum Computing Units

Superconducting In-Memory Computing Architecture Coupling with Memristor Synapses for Binarized Neural Networks

Proposal of Analog In-Memory Computing with Magnified Tunnel Magnetoresistance Ratio and Universal STT-MRAM Cell

In-Memory Computing Integrated Structure Circuit Based on Nonvolatile Flash Memory Unit

Neuromorphic Computing Systems with Emerging Nonvolatile Memories: A Circuits and Systems Perspective

Neuromorphic, Digital and Quantum Computation with Memory Circuit Elements