Abstract:Process in memory (PIM) is a promising solution to address the “memory wall” issue, and most of the proposed PIM architectures integrate logic with memory. However, as long as the computation is done by logic, it needs to access memory for data. In this work, we propose a novel PIM system, utilizing metal-oxide resistive random access memory (ReRAM) as main memory and also for computation. As an emerging non-volatile memory, ReRAM has been considered as a promising candidate for future memory architecture, thanks to its high density, fast read access, and low leakage power. In addition, it has the capability to represent synaptic weights and execute neural networks with its crossbar architecture. Our proposed design is based on a ReRAM-based main memory system. In the proposed design, a portion of ReRAM crossbar arrays can be configured either as normal memory or to be used for neural computation (hence a morphable PIM structure). We design the required peripheral circuits by computing carefully to minimize the area overhead, and also to provide a hardwaresoftware interface for the developers so that they can easily configure the proposed design for various neural network tasks. We evaluate the proposed design on two sets of benchmarks, and compare it with a CPU-only solution and two neural process unit (NPU) solutions (using NPUs as co-processors and as PIM-processors through 3D stacking). The experiment results show that the proposed design achieve the best energy-efficiency with the highest speedup, which is ∼9000× faster than the CPU-only solution for large neural networks. In addition, it is also a low-overhead PIM solution, with only < 3.8% area overhead compared to the normal ReRAM chips.

A 462gops/j RRAM-based Nonvolatile Intelligent Processor for Energy Harvesting IoE System Featuring Nonvolatile Logics and Processing-in-memory

An 8-Bit in Resistive Memory Computing Core with Regulated Passive Neuron and Bitline Weight Mapping

A Robust 8-Bit Non-Volatile Computing-in-Memory Core for Low-Power Parallel MAC Operations.

A 3.89-Gops/mw Scalable Recurrent Neural Network Processor with Improved Efficiency on Memory and Computation

A 65-Nm ReRAM-Enabled Nonvolatile Processor with Time-Space Domain Adaption and Self-Write-Termination Achieving $> 4\times $ Faster Clock Frequency and $> 6\times $ Higher Restore Speed

4.7 A 65nm ReRAM-enabled nonvolatile processor with 6× reduction in restore time and 4× higher clock frequency using adaptive data retention and self-write-termination nonvolatile logic

A Heterogeneous Microprocessor for Intermittent AI Inference Using Nonvolatile-SRAM-based Compute-In-Memory

A 130-Nm Ferroelectric Nonvolatile System-on-Chip with Direct Peripheral Restore Architecture for Transient Computing System

A ReRAM-based Single-Nvm Nonvolatile Flip-Flop with Reduced Stress-Time and Write-Power Against Wide Distribution in Write-Time by Using Self-Write-termination Scheme for Nonvolatile Processors in IoT Era

RRAM-based Spiking Nonvolatile Computing-In-Memory Processing Engine with Precision-Configurable in Situ Nonlinear Activation

Efficient and Robust Nonvolatile Computing-In-Memory Based on Voltage Division in 2T2R RRAM with Input-Dependent Sensing Control

CMOS-integrated memristive non-volatile computing-in-memory for AI edge processors

A Fully Logic CMOS Compatible Non-Volatile Memory for Low Power IoT Applications

A Heterogeneous Microprocessor Based on All-Digital Compute-in-Memory for End-to-End AIoT Inference

SEAL-lab Technical Report – No . 2015-001 ( April 29 , 2016 ) Processing-in-Memory in ReRAM-based Main Memory

SEAL-lab Technical Report – No . 2015-001 ( November 30 , 2015 ) Processing-in-Memory in ReRAM-based Main Memory

A 28-Nm RRAM Computing-in-Memory Macro Using Weighted Hybrid 2T1R Cell Array and Reference Subtracting Sense Amplifier for AI Edge Inference

A 28nm Hybrid 2T1R RRAM Computing-in-Memory Macro for Energy-efficient AI Edge Inference

Neuromorphic Computing Based on Resistive RAM.

A 28 nm 81 Kb 5995.3 TOPS/W 4T2R ReRAM Computing-in-Memory Accelerator With Voltage-to-Time-to-Digital Based Output

Neural-PIM: Efficient Processing-In-Memory with Neural Approximation of Peripherals