Abstract:RRAM-based in-memory computing (IMC) effectively accelerates deep neural networks (DNNs) and other machine learning algorithms. On the other hand, in the presence of RRAM device variations and lower precision, the mapping of DNNs to RRAM-based IMC suffers from severe accuracy loss. In this work, we propose a novel hybrid IMC architecture that integrates an RRAM-based IMC macro with a digital SRAM macro using a programmable shifter to compensate for the RRAM variations and recover the accuracy. The digital SRAM macro consists of a small SRAM memory array and an array of multiply-and-accumulate (MAC) units. The nonideal output from the RRAM macro, due to device and circuit nonidealities, is compensated by adding the precise output from the SRAM macro. In addition, the programmable shifter allows for different scales of compensation by shifting the SRAM macro output relative to the RRAM macro output. On the algorithm side, we develop a framework for the training of DNNs to support the hybrid IMC architecture through ensemble learning. The proposed framework performs quantization (weights and activations), pruning, RRAM IMC-aware training, and employs ensemble learning through different compensation scales by utilizing the programmable shifter. Finally, we design a silicon prototype of the proposed hybrid IMC architecture in the 65-nm SUNY process to demonstrate its efficacy. Experimental evaluation of the hybrid IMC architecture shows that the SRAM compensation allows for a realistic IMC architecture with multilevel RRAM cells (MLCs) even though they suffer from high variations. The hybrid IMC architecture achieves up to 21.9%, 12.65%, and 6.52% improvement in post-mapping accuracy over state-of-the-art techniques, at minimal overhead, for ResNet-20 on CIFAR-10, VGG-16 on CIFAR-10, and ResNet-18 on ImageNet, respectively.

Applications Of Generic In-Memory Computing Architecture Platform Based On Sram To Internet Of Things

Modeling and Benchmarking Computing-in-Memory for Design Space Exploration.

Computing-in-memory Circuits and Cross-Layer Integrated Design and Optimization: from SRAM to FeFET

Current Research Status and Future Prospect of the In-Memory Computing

In-Memory Computing: The Next-Generation AI Computing Paradigm

DM-IMCA: A Dual-Mode In-Memory Computing Architecture for General Purpose Processing.

Benchmarking and modeling of analog and digital SRAM in-memory computing architectures

In-memory Computing to Break the Memory Wall

Device-Architecture Co-optimization for RRAM-based In-memory Computing.

SRAM-based Compute-in-memory: Status and Challenges

In-memory Computing with Emerging Nonvolatile Memory Devices

Challenges and Trends of SRAM-Based Computing-In-Memory for AI Edge Devices

A Heterogeneous Microprocessor for Intermittent AI Inference Using Nonvolatile-SRAM-based Compute-In-Memory

A Heterogeneous Microprocessor Based on All-Digital Compute-in-Memory for End-to-End AIoT Inference

A Processing-In-Memory Architecture Programming Paradigm For Wireless Internet-Of-Things Applications

Hybrid RRAM/SRAM in-Memory Computing for Robust DNN Acceleration

Domain-Specific STT-MRAM-Based In-Memory Computing: A Survey

Configurable in-memory computing architecture based on dual-port SRAM

Device and Circuit Architectures for In‐Memory Computing

Intelligent Computing with RRAM

Toward Memristive In-Memory Computing: Principles and Applications