Abstract:Realizing today's cloud-level artificial intelligence functionalities directly on devices distributed at the edge of the internet calls for edge hardware capable of processing multiple modalities of sensory data (e.g. video, audio) at unprecedented energy-efficiency. AI hardware architectures today cannot meet the demand due to a fundamental "memory wall": data movement between separate compute and memory units consumes large energy and incurs long latency. Resistive random-access memory (RRAM) based compute-in-memory (CIM) architectures promise to bring orders of magnitude energy-efficiency improvement by performing computation directly within memory. However, conventional approaches to CIM hardware design limit its functional flexibility necessary for processing diverse AI workloads, and must overcome hardware imperfections that degrade inference accuracy. Such trade-offs between efficiency, versatility and accuracy cannot be addressed by isolated improvements on any single level of the design. By co-optimizing across all hierarchies of the design from algorithms and architecture to circuits and devices, we present NeuRRAM - the first multimodal edge AI chip using RRAM CIM to simultaneously deliver a high degree of versatility for diverse model architectures, record energy-efficiency $5\times$ - $8\times$ better than prior art across various computational bit-precisions, and inference accuracy comparable to software models with 4-bit weights on all measured standard AI benchmarks including accuracy of 99.0% on MNIST and 85.7% on CIFAR-10 image classification, 84.7% accuracy on Google speech command recognition, and a 70% reduction in image reconstruction error on a Bayesian image recovery task. This work paves a way towards building highly efficient and reconfigurable edge AI hardware platforms for the more demanding and heterogeneous AI applications of the future.

Neural Network Acceleration and Voice Recognition with a Flash-based In-Memory Computing SoC

A Robust 8-Bit Non-Volatile Computing-in-Memory Core for Low-Power Parallel MAC Operations.

DaDianNao: A Machine-Learning Supercomputer

Flash-based Computing In-Memory Scheme for IOT.

Neural Networks on Chip: from CMOS Accelerators to In-Memory-Computing

A Heterogeneous Microprocessor Based on All-Digital Compute-in-Memory for End-to-End AIoT Inference

Design of Computing-in-Memory (CIM) with Vertical Split-Gate Flash Memory for Deep Neural Network (DNN) Inference Accelerator

Flash Memory Array for Efficient Implementation of Deep Neural Networks

NS-Engine: Near-Sensor Neural Network Engine with SRAM-Based Compute-in-Memory Macro

In-Memory Computing Integrated Structure Circuit Based on Nonvolatile Flash Memory Unit

Special Topic on Nonvolatile Memory for Efficient Implementation of Neural/Neuromorphic Computing

Small Area Configurable Deep Neural Network Accelerator for IoT System

A Heterogeneous Microprocessor for Intermittent AI Inference Using Nonvolatile-SRAM-based Compute-In-Memory

A Fully Integrated System‐on‐Chip Design with Scalable Resistive Random‐Access Memory Tile Design for Analog in‐Memory Computing

Edge AI without Compromise: Efficient, Versatile and Accurate Neurocomputing in Resistive Random-Access Memory

A 64-core mixed-signal in-memory compute chip based on phase-change memory for deep neural network inference

AIMMI: Audio and Image Multi-Modal Intelligence Via a Low-Power SoC with 2-Mbyte On-Chip MRAM for IoT Devices

Energy-efficient SNN Architecture using 3nm FinFET Multiport SRAM-based CIM with Online Learning

A Hybrid RRAM-SRAM Computing-In-Memory Architecture for Deep Neural Network Inference-Training Edge Acceleration

In-Memory Computing: The Next-Generation AI Computing Paradigm

RRAM-based Analog-Weight Spiking Neural Network Accelerator with In-Situ Learning for IoT Applications