Abstract:Deep learning hardware designs have been bottlenecked by conventional memories such as SRAM due to density, leakage and parallel computing challenges. Resistive devices can address the density and volatility issues, but have been limited by peripheral circuit integration. In this work, we demonstrate a scalable RRAM based in-memory computing design, termed XNOR-RRAM, which is fabricated in a 90nm CMOS technology with monolithic integration of RRAM devices between metal 1 and 2. We integrated a 128x64 RRAM array with CMOS peripheral circuits including row/column decoders and flash analog-to-digital converters (ADCs), which collectively become a core component for scalable RRAM-based in-memory computing towards large deep neural networks (DNNs). To maximize the parallelism of in-memory computing, we assert all 128 wordlines of the RRAM array simultaneously, perform analog computing along the bitlines, and digitize the bitline voltages using ADCs. The resistance distribution of low resistance states is tightened by write-verify scheme, and the ADC offset is calibrated. Prototype chip measurements show that the proposed design achieves high binary DNN accuracy of 98.5% for MNIST and 83.5% for CIFAR-10 datasets, respectively, with energy efficiency of 24 TOPS/W and 158 GOPS throughput. This represents 5.6X, 3.2X, 14.1X improvements in throughput, energy-delay product (EDP), and energy-delay-squared product (ED2P), respectively, compared to the state-of-the-art literature. The proposed XNOR-RRAM can enable intelligent functionalities for area-/energy-constrained edge computing devices.

Energy efficient in-memory machine learning for data intensive image-processing by non-volatile domain-wall memory

The Impact of Non-linear NVM Devices on In-Memory Computing

DaDianNao: A Machine-Learning Supercomputer

An area and energy efficient design of domain-wall memory-based deep convolutional neural networks using stochastic computing

Multilevel Ferroelectric Domain Wall Memory for Neuromorphic Computing

Multi‐Functional Ferroelectric Domain Wall Nanodevices for In‐Memory Computing and Light Sensing

An in-memory computing architecture based on a duplex 2D material structure for in-situ machine learning

An in-memory computing architecture based on a duplex two-dimensional material structure for in situ machine learning

Hardware Implementation of Energy Efficient Deep Learning Neural Network Based on Nanoscale Flash Computing Array

In-memory Computing with Emerging Nonvolatile Memory Devices

An Overview of In-memory Processing with Emerging Non-volatile Memory for Data-intensive Applications

Ferroelectric Domain Wall Memory and Logic

Neural Networks on Chip: from CMOS Accelerators to In-Memory-Computing

High-Throughput In-Memory Computing for Binary Deep Neural Networks with Monolithically Integrated RRAM and 90nm CMOS

Flash Memory Array for Efficient Implementation of Deep Neural Networks

Implementation of Highly Reliable and Energy‐Efficient Nonvolatile In‐Memory Computing Using Multistate Domain Wall Spin–Orbit Torque Device

A Hybrid RRAM-SRAM Computing-In-Memory Architecture for Deep Neural Network Inference-Training Edge Acceleration

Highly Efficient Neuromorphic Computing Systems with Emerging Nonvolatile Memories

Voltage-Driven Domain-Wall Motion based Neuro-Synaptic Devices for Dynamic On-line Learning

Enabling Lower-Power Charge-Domain Nonvolatile In-Memory Computing with Ferroelectric FETs

Efficient Discrete Temporal Coding Spike-Driven In-Memory Computing Macro for Deep Neural Network Based on Nonvolatile Memory.