Abstract:Processing-using-DRAM has been proposed for a limited set of basic operations (i.e., logic operations, addition). However, in order to enable full adoption of processing-using-DRAM, it is necessary to provide support for more complex operations. In this paper, we propose SIMDRAM, a flexible general-purpose processing-using-DRAM framework that (1) enables the efficient implementation of complex operations, and (2) provides a flexible mechanism tosupport the implementation of arbitrary user-defined operations. The SIMDRAM framework comprises three key steps. The first step builds an efficient MAJ/NOT representation of a given desired operation. The second step allocates DRAM rows that are reserved for computation to the operation’s input and output operands, and generates the required sequence of DRAM commands to perform the MAJ/NOT implementation of the desired operation in DRAM. The third step uses the SIMDRAM control unit located inside the memory controller to manage the computation of the operation from start to end, by executing the DRAM commands generated in the second step of the framework. We design the hardware and ISA support for SIMDRAM framework to (1) address key system integration challenges, and (2) allow programmers to employ new SIMDRAM operations without hardware changes. We evaluate SIMDRAM for reliability, area overhead, throughput, and energy efficiency using a wide range of operations and seven real-world applications to demonstrate SIMDRAM’s generality. Our evaluations using a single DRAM bank show that (1) over 16 operations, SIMDRAM provides 2.0X the throughput and 2.6X the energy efficiency of Ambit, a state-of-the-art processing-using-DRAM mechanism; (2) over seven real-world applications, SIMDRAM provides 2.5X the performance of Ambit. Using 16 DRAM banks, SIMDRAM provides (1) 88X and 5.8X the throughput, and 257X and 31X the energy efficiency, of a CPU and a high-end GPU, respectively, over 16 operations; (2) 21X and 2.1X the performance of the CPU and GPU, over seven real-world applications. SIMDRAM incurs an area overhead of only 0.2% in a high-end CPU.

Max-PIM: Fast and Efficient Max/Min Searching in DRAM

PIM-DH: Re RAM-based Processing-in-Memory Architecture for Deep Hashing Acceleration

A design framework for processing-in-memory accelerator

Ultrafast Self-Rectifying Memristors for Advanced In-Memory Computing

Breaking the von Neumann bottleneck: architecture-level processing-in-memory technology

Enabling the Adoption of Processing-in-Memory: Challenges, Mechanisms, Future Research Directions

Shared-PIM: Enabling Concurrent Computation and Data Flow for Faster Processing-in-DRAM

Hardware Architecture and Software Stack for PIM Based on Commercial DRAM Technology : Industrial Product

PIMSAB: A Processing-In-Memory System with Spatially-Aware Communication and Bit-Serial-Aware Computation

AritPIM: High-Throughput In-Memory Arithmetic

DRIM-ANN: An Approximate Nearest Neighbor Search Engine based on Commercial DRAM-PIMs

DDC-PIM: Efficient Algorithm/Architecture Co-design for Doubling Data Capacity of SRAM-based Processing-In-Memory

Neural-PIM: Efficient Processing-In-Memory with Neural Approximation of Peripherals

BafSP: Co-Design of Compute SRAM and Bit-Aware Data Flip Mitigation with In-Memory Sparsity Detection for SpMM

A$^3$PIM: An Automated, Analytic and Accurate Processing-in-Memory Offloader

Darwin: A DRAM-based Multi-level Processing-in-Memory Architecture for Data Analytics

Parallel Stateful Logic in RRAM: Theoretical Analysis and Arithmetic Design

RIMAC: an Array-Level ADC/DAC-Free ReRAM-Based In-Memory DNN Processor with Analog Cache and Computation.

A Case for In-Memory Random Scatter-Gather for Fast Graph Processing

SIMDRAM: a framework for bit-serial SIMD processing using DRAM

CHIME: Energy-Efficient STT-RAM-based Concurrent Hierarchical In-Memory Processing