Abstract:RRAM-based in-memory computing (IMC) effectively accelerates deep neural networks (DNNs) and other machine learning algorithms. On the other hand, in the presence of RRAM device variations and lower precision, the mapping of DNNs to RRAM-based IMC suffers from severe accuracy loss. In this work, we propose a novel hybrid IMC architecture that integrates an RRAM-based IMC macro with a digital SRAM macro using a programmable shifter to compensate for the RRAM variations and recover the accuracy. The digital SRAM macro consists of a small SRAM memory array and an array of multiply-and-accumulate (MAC) units. The nonideal output from the RRAM macro, due to device and circuit nonidealities, is compensated by adding the precise output from the SRAM macro. In addition, the programmable shifter allows for different scales of compensation by shifting the SRAM macro output relative to the RRAM macro output. On the algorithm side, we develop a framework for the training of DNNs to support the hybrid IMC architecture through ensemble learning. The proposed framework performs quantization (weights and activations), pruning, RRAM IMC-aware training, and employs ensemble learning through different compensation scales by utilizing the programmable shifter. Finally, we design a silicon prototype of the proposed hybrid IMC architecture in the 65-nm SUNY process to demonstrate its efficacy. Experimental evaluation of the hybrid IMC architecture shows that the SRAM compensation allows for a realistic IMC architecture with multilevel RRAM cells (MLCs) even though they suffer from high variations. The hybrid IMC architecture achieves up to 21.9%, 12.65%, and 6.52% improvement in post-mapping accuracy over state-of-the-art techniques, at minimal overhead, for ResNet-20 on CIFAR-10, VGG-16 on CIFAR-10, and ResNet-18 on ImageNet, respectively.

Hdc-Im: Hyperdimensional Computing In-Memory Architecture Based On Rram

A ReRAM-Based Processing-In-Memory Architecture for Hyperdimensional Computing

Robust In-Memory Computing with Hyperdimensional Stochastic Representation

FeFET-Based In-Memory Hyperdimensional Encoding Design

2T2R RRAM-Based In-Memory Hyperdimensional Computing Encoder for Spatio-Temporal Signal Processing

In-memory hyperdimensional computing

Energy Efficient In-memory Hyperdimensional Encoding for Spatio-temporal Signal Processing

Hybrid RRAM/SRAM in-Memory Computing for Robust DNN Acceleration

3D Parallel ReRAM Computation-in-Memory for Hyperdimensional Computing

Memristor-Based Approximate Query Architecture for In-Memory Hyperdimensional Computing

CLEAR: a Full-Stack Chip-in-loop Emulator for Analog RRAM Based Computing-in-memory System

A 5 μW Standard Cell Memory-based Configurable Hyperdimensional Computing Accelerator for Always-on Smart Sensing

Heterogeneous Instruction Set Architecture for RRAM-enabled In-memory Computing.

A compute-in-memory chip based on resistive random-access memory

RRAM-based CAM combined with time-domain circuits for hyperdimensional computing

Energy-Efficient Hybrid-RAM with Hybrid Bit-Serial Based VMM Support

High-Throughput In-Memory Computing for Binary Deep Neural Networks with Monolithically Integrated RRAM and 90nm CMOS

Energy-Efficient Brain-Inspired Hyperdimensional Computing Using Voltage Scaling

Store-n-Learn: Classification and Clustering with Hyperdimensional Computing across Flash Hierarchy

HD-CIM: Hybrid-Device Computing-In-Memory Structure Based on MRAM and SRAM to Reduce Weight Loading Energy of Neural Networks

A Heterogeneous Microprocessor for Intermittent AI Inference Using Nonvolatile-SRAM-based Compute-In-Memory