Abstract:Realizing increasingly complex artificial intelligence (AI) functionalities directly on edge devices calls for unprecedented energy efficiency of edge hardware. Compute-in-memory (CIM) based on resistive random-access memory (RRAM) 1 promises to meet such demand by storing AI model weights in dense, analogue and non-volatile RRAM devices, and by performing AI computation directly within RRAM, thus eliminating power-hungry data movement between separate compute and memory 2,3,4,5 . Although recent studies have demonstrated in-memory matrix-vector multiplication on fully integrated RRAM-CIM hardware 6,7,8,9,10,11,12,13,14,15,16,17 , it remains a goal for a RRAM-CIM chip to simultaneously deliver high energy efficiency, versatility to support diverse models and software-comparable accuracy. Although efficiency, versatility and accuracy are all indispensable for broad adoption of the technology, the inter-related trade-offs among them cannot be addressed by isolated improvements on any single abstraction level of the design. Here, by co-optimizing across all hierarchies of the design from algorithms and architecture to circuits and devices, we present NeuRRAM—a RRAM-based CIM chip that simultaneously delivers versatility in reconfiguring CIM cores for diverse model architectures, energy efficiency that is two-times better than previous state-of-the-art RRAM-CIM chips across various computational bit-precisions, and inference accuracy comparable to software models quantized to four-bit weights across various AI tasks, including accuracy of 99.0 percent on MNIST 18 and 85.7 percent on CIFAR-10 19 image classification, 84.7-percent accuracy on Google speech command recognition 20 , and a 70-percent reduction in image-reconstruction error on a Bayesian image-recovery task.

An Energy-Efficient Matrix Multiplication Accelerator by Distributed In-Memory Computing on Binary RRAM Crossbar.

Technological Exploration of Rram Crossbar Array for Matrix-Vector Multiplication

RRAM-Based Single Device for Vector Multiplication and Multibit Storage with Ultrahigh Area Efficiency

Efficient Evaluation Model Including Interconnect Resistance Effect for Large Scale RRAM Crossbar Array Matrix Computing

Efficient In-Memory Computing Architecture Based On Crossbar Arrays

A 3d Multi-Layer Cmos-Rram Accelerator for Neural Network

TAC-RAM: A 65nm 4kb SRAM Computing-in-Memory Design with 57.55 TOPS/W Supporting Multibit Matrix-Vector Multiplication for Binarized Neural Network.

High-Throughput In-Memory Computing for Binary Deep Neural Networks with Monolithically Integrated RRAM and 90nm CMOS

A Universal RRAM-Based DNN Accelerator with Programmable Crossbars Beyond MVM Operator

Optimizing Boolean embedding matrix for compressive sensing in RRAM crossbar

A 28nm Hybrid 2T1R RRAM Computing-in-Memory Macro for Energy-efficient AI Edge Inference

An RRAM-Based Digital Computing-in-Memory Macro with Dynamic Voltage Sense Amplifier and Sparse-Aware Approximate Adder Tree

A Low-Latency DNN Accelerator Enabled by DFT-Based Convolution Execution Within Crossbar Arrays

14.2 A Compute SRAM with Bit-Serial Integer/Floating-Point Operations for Programmable In-Memory Vector Acceleration

An Energy Efficient Computing-in-Memory Accelerator With 1T2R Cell and Fully Analog Processing for Edge AI Applications

A compute-in-memory chip based on resistive random-access memory

IM3A: Boosting Deep Neural Network Efficiency via In-Memory Addressing-Assisted Acceleration

Data Matching Engine for Efficient Big Data Searching Systems Using a RRAM Based Novel Computing Paradigm

Resistive Memory‐Based In‐Memory Computing: From Device and Large‐Scale Integration System Perspectives

In-Memory Wallace Tree Multipliers Based on Majority Gates Within Voltage-Gated SOT-MRAM Crossbar Arrays

REAL: Logic and Arithmetic Operations Embedded in RRAM for General-Purpose Computing