Abstract:Realizing increasingly complex artificial intelligence (AI) functionalities directly on edge devices calls for unprecedented energy efficiency of edge hardware. Compute-in-memory (CIM) based on resistive random-access memory (RRAM) 1 promises to meet such demand by storing AI model weights in dense, analogue and non-volatile RRAM devices, and by performing AI computation directly within RRAM, thus eliminating power-hungry data movement between separate compute and memory 2,3,4,5 . Although recent studies have demonstrated in-memory matrix-vector multiplication on fully integrated RRAM-CIM hardware 6,7,8,9,10,11,12,13,14,15,16,17 , it remains a goal for a RRAM-CIM chip to simultaneously deliver high energy efficiency, versatility to support diverse models and software-comparable accuracy. Although efficiency, versatility and accuracy are all indispensable for broad adoption of the technology, the inter-related trade-offs among them cannot be addressed by isolated improvements on any single abstraction level of the design. Here, by co-optimizing across all hierarchies of the design from algorithms and architecture to circuits and devices, we present NeuRRAM—a RRAM-based CIM chip that simultaneously delivers versatility in reconfiguring CIM cores for diverse model architectures, energy efficiency that is two-times better than previous state-of-the-art RRAM-CIM chips across various computational bit-precisions, and inference accuracy comparable to software models quantized to four-bit weights across various AI tasks, including accuracy of 99.0 percent on MNIST 18 and 85.7 percent on CIFAR-10 19 image classification, 84.7-percent accuracy on Google speech command recognition 20 , and a 70-percent reduction in image-reconstruction error on a Bayesian image-recovery task.

System and Technology Co-optimization for RRAM Based Computation-in-memory Chip

Architecture-circuit-technology Co-Optimization for Resistive Random Access Memory-Based Computation-in-memory Chips

Modeling and Benchmarking Computing-in-Memory for Design Space Exploration.

Computing-in-memory Circuits and Cross-Layer Integrated Design and Optimization: from SRAM to FeFET

Electrothermal Simulation of Resistive Random Access Memory(RRAM) Array Using Finite Difference Method

Technology-Array-Algorithm Co-Optimization of RRAM for Storage and Neuromorphic Computing: Device Non-idealities and Thermal Cross-talk

Intra-array Non-Idealities Modeling and Algorithm Optimization for RRAM-based Computing-in-Memory Applications

Device-Architecture Co-optimization for RRAM-based In-memory Computing.

A Circuit-Algorithm Codesign Method to Reduce the Accuracy Drop of RRAM Based Computing-in-memory Chip

Enabling RRAM-Based Brain-Inspired Computation by Co-design of Device, Circuit, and System

Accuracy Optimization with the Framework of Non-Volatile Computing-In-Memory Systems

A Compact Model for Relaxation Effect in Analog RRAM for Computation-in-Memory System Design and Benchmark

A Compact Model of Analog RRAM With Device and Array Nonideal Effects for Neuromorphic Systems

Variation-aware, Reliability-Emphasized Design and Optimization of RRAM Using SPICE Model

Intelligent Computing with RRAM

Statistical assessment methodology for the design and optimization of cross-point RRAM arrays

Design Guidelines of RRAM Based Neural-Processing-Unit

Architectural Exploration of Application-Specific Resonant SRAM Compute-in-Memory (rCiM)

Compensation Architecture Design Utilizing Residual Resource to Mitigate Impacts of Nonidealities in RRAM-based Computing-in-memory Chips

Design And Optimization Methodology For 3d Rram Arrays

A compute-in-memory chip based on resistive random-access memory