Abstract:Deep learning hardware designs have been bottlenecked by conventional memories such as SRAM due to density, leakage and parallel computing challenges. Resistive devices can address the density and volatility issues, but have been limited by peripheral circuit integration. In this work, we demonstrate a scalable RRAM based in-memory computing design, termed XNOR-RRAM, which is fabricated in a 90nm CMOS technology with monolithic integration of RRAM devices between metal 1 and 2. We integrated a 128x64 RRAM array with CMOS peripheral circuits including row/column decoders and flash analog-to-digital converters (ADCs), which collectively become a core component for scalable RRAM-based in-memory computing towards large deep neural networks (DNNs). To maximize the parallelism of in-memory computing, we assert all 128 wordlines of the RRAM array simultaneously, perform analog computing along the bitlines, and digitize the bitline voltages using ADCs. The resistance distribution of low resistance states is tightened by write-verify scheme, and the ADC offset is calibrated. Prototype chip measurements show that the proposed design achieves high binary DNN accuracy of 98.5% for MNIST and 83.5% for CIFAR-10 datasets, respectively, with energy efficiency of 24 TOPS/W and 158 GOPS throughput. This represents 5.6X, 3.2X, 14.1X improvements in throughput, energy-delay product (EDP), and energy-delay-squared product (ED2P), respectively, compared to the state-of-the-art literature. The proposed XNOR-RRAM can enable intelligent functionalities for area-/energy-constrained edge computing devices.

Time complexity of in-memory solution of linear systems

The Impact of Non-linear NVM Devices on In-Memory Computing

DaDianNao: A Machine-Learning Supercomputer

Optimization Schemes for In-Memory Linear Regression Circuit With Memristor Arrays

In-Memory Computing: Advances and Prospects

A Low-Power In-Memory Multiplication and Accumulation Array with Modified Radix-4 Input and Canonical Signed Digit Weights

In-memory Computing with Emerging Nonvolatile Memory Devices

Mixed-Precision In-Memory Computing

Resistive Memory‐Based In‐Memory Computing: From Device and Large‐Scale Integration System Perspectives

Emerging Nonvolatile Memories for Machine Learning

Energy Scaling Advantages of Resistive Memory Crossbar Based Computation and Its Application to Sparse Coding

In-memory Computing to Break the Memory Wall

BlockAMC: Scalable In-Memory Analog Matrix Computing for Solving Linear Systems

In-Memory Computing With Memristor Arrays

Efficient In-Memory Computing Architecture Based On Crossbar Arrays

Sparse matrix multiplication in a record-low power self-rectifying memristor array for scientific computing

14.2 A Compute SRAM with Bit-Serial Integer/Floating-Point Operations for Programmable In-Memory Vector Acceleration

High-Throughput In-Memory Computing for Binary Deep Neural Networks with Monolithically Integrated RRAM and 90nm CMOS

Leveraging Spintronic Devices for Ultra-Low Power In-Memory Computing: Logic and Neural Network.

Novel In-Memory Matrix-Matrix Multiplication with Resistive Cross-Point Arrays

Tutorial: Analog Matrix Computing (AMC) with Crosspoint Resistive Memory Arrays