Abstract:Realizing today's cloud-level artificial intelligence functionalities directly on devices distributed at the edge of the internet calls for edge hardware capable of processing multiple modalities of sensory data (e.g. video, audio) at unprecedented energy-efficiency. AI hardware architectures today cannot meet the demand due to a fundamental "memory wall": data movement between separate compute and memory units consumes large energy and incurs long latency. Resistive random-access memory (RRAM) based compute-in-memory (CIM) architectures promise to bring orders of magnitude energy-efficiency improvement by performing computation directly within memory. However, conventional approaches to CIM hardware design limit its functional flexibility necessary for processing diverse AI workloads, and must overcome hardware imperfections that degrade inference accuracy. Such trade-offs between efficiency, versatility and accuracy cannot be addressed by isolated improvements on any single level of the design. By co-optimizing across all hierarchies of the design from algorithms and architecture to circuits and devices, we present NeuRRAM - the first multimodal edge AI chip using RRAM CIM to simultaneously deliver a high degree of versatility for diverse model architectures, record energy-efficiency $5\times$ - $8\times$ better than prior art across various computational bit-precisions, and inference accuracy comparable to software models with 4-bit weights on all measured standard AI benchmarks including accuracy of 99.0% on MNIST and 85.7% on CIFAR-10 image classification, 84.7% accuracy on Google speech command recognition, and a 70% reduction in image reconstruction error on a Bayesian image recovery task. This work paves a way towards building highly efficient and reconfigurable edge AI hardware platforms for the more demanding and heterogeneous AI applications of the future.

ARYABHAT: A Digital-Like Field Programmable Analog Computing Array for Edge AI

A Robust 8-Bit Non-Volatile Computing-in-Memory Core for Low-Power Parallel MAC Operations.

Process, Bias and Temperature Scalable CMOS Analog Computing Circuits for Machine Learning

BRYT: Data Rich Analytics Based Computer Architecture for A New Paradigm of Chip Design

ALPINE: Analog In-Memory Acceleration with Tight Processor Integration for Deep Learning

BRYT: Data Rich Analytics Based Computer Architecture for A New Paradigm of Chip Design to Supplant Moore's Law

FPCA: Field-Programmable Pixel Convolutional Array for Extreme-Edge Intelligence

Containing Analog Data Deluge at Edge through Frequency-Domain Compression in Collaborative Compute-in-Memory Networks

High Performance Scalable FPGA Accelerator for Deep Neural Networks

Prospects for Analog Circuits in Deep Networks

Multi-Function Multi-Way Analog Technology for Sustainable Machine Intelligence Computation

Analog fast Fourier transforms for scalable and efficient signal processing

Design of Novel Analog Compute Paradigms with Ark

Analog System High-Level Synthesis for Energy-Efficient Reconfigurable Computing

AHA: An Agile Approach to the Design of Coarse-Grained Reconfigurable Accelerators and Compilers

Multiplierless MP-Kernel Machine for Energy-Efficient Edge Devices

Edge AI without Compromise: Efficient, Versatile and Accurate Neurocomputing in Resistive Random-Access Memory

Towards Power Efficient DNN Accelerator Design on Reconfigurable Platform

Circuit and System Technologies for Energy-Efficient Edge Robotics

AnalogNAS: A Neural Network Design Framework for Accurate Inference with Analog In-Memory Computing

ISAAC: A Convolutional Neural Network Accelerator with In-Situ Analog Arithmetic in Crossbars