Abstract:RRAM-based in-memory computing (IMC) effectively accelerates deep neural networks (DNNs) and other machine learning algorithms. On the other hand, in the presence of RRAM device variations and lower precision, the mapping of DNNs to RRAM-based IMC suffers from severe accuracy loss. In this work, we propose a novel hybrid IMC architecture that integrates an RRAM-based IMC macro with a digital SRAM macro using a programmable shifter to compensate for the RRAM variations and recover the accuracy. The digital SRAM macro consists of a small SRAM memory array and an array of multiply-and-accumulate (MAC) units. The nonideal output from the RRAM macro, due to device and circuit nonidealities, is compensated by adding the precise output from the SRAM macro. In addition, the programmable shifter allows for different scales of compensation by shifting the SRAM macro output relative to the RRAM macro output. On the algorithm side, we develop a framework for the training of DNNs to support the hybrid IMC architecture through ensemble learning. The proposed framework performs quantization (weights and activations), pruning, RRAM IMC-aware training, and employs ensemble learning through different compensation scales by utilizing the programmable shifter. Finally, we design a silicon prototype of the proposed hybrid IMC architecture in the 65-nm SUNY process to demonstrate its efficacy. Experimental evaluation of the hybrid IMC architecture shows that the SRAM compensation allows for a realistic IMC architecture with multilevel RRAM cells (MLCs) even though they suffer from high variations. The hybrid IMC architecture achieves up to 21.9%, 12.65%, and 6.52% improvement in post-mapping accuracy over state-of-the-art techniques, at minimal overhead, for ResNet-20 on CIFAR-10, VGG-16 on CIFAR-10, and ResNet-18 on ImageNet, respectively.

Monolithic Three-Dimensional Integration of RRAM-based Hybrid Memory Architecture for One-Shot Learning

Monolithic 3D Integration of Logic, Memory and Computing-In-Memory for One-Shot Learning

A Hybrid Computing-In-Memory Architecture by Monolithic 3D Integration of BEOL CNT/IGZO-based CFET Logic and Analog RRAM

Monolithic 3-D Integration of Counteractive Coupling IGZO/CNT Hybrid 2T0C DRAM and Analog RRAM-Based Computing-In-Memory

Fully Integrated 3-D Stackable CNTFET/RRAM 1T1R Array As BEOL Buffer Macro for Monolithic 3-D Integration with Analog RRAM-Based Computing-in-Memory

Monolithic 3D Integration of FeFET, Hybrid CMOS Logic and Analog RRAM Array for Energy-Efficient Reconfigurable Computing-In-Memory Architecture.

Counteractive Coupling IGZO/CNT Hybrid 2T0C DRAM Accelerating RRAM-based Computing-In-Memory Via Monolithic 3D Integration for Edge AI

3D Stackable CNTFET/RRAM 1T1R Array with CNT CMOS Peripheral Circuits as BEOL Buffer Macro for Monolithic 3D Integration with Analog RRAM-based Computing-In-Memory

Monolithic 3D Integration of Analog RRAM‐Based Computing‐in‐Memory and Sensor for Energy‐Efficient Near‐Sensor Computing (Adv. Mater. 22/2024)

Hybrid RRAM/SRAM in-Memory Computing for Robust DNN Acceleration

SAPIENS: A 64-kb RRAM-Based Non-Volatile Associative Memory for One-Shot Learning and Inference at the Edge

A Monolithic-3D SRAM Design with Enhanced Robustness and In-Memory Computation Support

Resistive Memory‐Based In‐Memory Computing: From Device and Large‐Scale Integration System Perspectives

Monolithic 3D Integration of Dendritic Neural Network with Memristive Synapse, Dendrite and Soma on Si CMOS

High-Throughput In-Memory Computing for Binary Deep Neural Networks with Monolithically Integrated RRAM and 90nm CMOS

A 3d Multi-Layer Cmos-Rram Accelerator for Neural Network

On-Device Continual Learning with STT-Assisted-SOT MRAM Based In-Memory Computing

Ferroelectric FET Based In-Memory Computing for Few-Shot Learning.

Monolithic 3D integration of 2D transistors and vertical RRAMs in 1T–4R structure for high-density memory

A Hybrid RRAM-SRAM Computing-In-Memory Architecture for Deep Neural Network Inference-Training Edge Acceleration

A Fully Integrated System‐on‐Chip Design with Scalable Resistive Random‐Access Memory Tile Design for Analog in‐Memory Computing