Abstract:Poor DRAM technology scaling over the course of many years has caused DRAM-based main memory to increasingly become a larger system bottleneck. A major reason for the bottleneck is that data stored within DRAM must be moved across a pin-limited memory channel to the CPU before any computation can take place. This requires a high latency and energy overhead, and the data often cannot benefit from caching in the CPU, making it difficult to amortize the overhead. Modern 3D-stacked DRAM architectures include a logic layer, where compute logic can be integrated underneath multiple layers of DRAM cell arrays within the same chip. Architects can take advantage of the logic layer to perform processing-in-memory (PIM), or near-data processing. In a PIM architecture, the logic layer within DRAM has access to the high internal bandwidth available within 3D-stacked DRAM (which is much greater than the bandwidth available between DRAM and the CPU). Thus, PIM architectures can effectively free up valuable memory channel bandwidth while reducing system energy consumption. A number of important issues arise when we add compute logic to DRAM. In particular, the logic does not have low-latency access to common CPU structures that are essential for modern application execution, such as the virtual memory and cache coherence mechanisms. To ease the widespread adoption of PIM, we ideally would like to maintain traditional virtual memory abstractions and the shared memory programming model. This requires efficient mechanisms that can provide logic in DRAM with access to CPU structures without having to communicate frequently with the CPU. To this end, we propose and evaluate two general-purpose solutions that minimize unnecessary off-chip communication for PIM architectures. We show that both mechanisms improve the performance and energy consumption of many important memory-intensive applications.

Bidirectional Database Storage and SQL Query Exploiting RRAM-Based Process-in-Memory Structure

Energy-efficient SQL query exploiting RRAM-based process-in-memory structure

Architecting Heterogeneous Memory Systems with DRAM Technology Only: A Case Study on Relational Database.

Enabling the Adoption of Processing-in-Memory: Challenges, Mechanisms, Future Research Directions

A Performance Evaluation of DRAM Access for In-Memory Databases

Energy Efficient Computing with High-Density, Field-Free STT-Assisted SOT-MRAM (SAS-MRAM)

RRAM-Based Single Device for Vector Multiplication and Multibit Storage with Ultrahigh Area Efficiency

ProPRAM

An Energy-Efficient Matrix Multiplication Accelerator by Distributed In-Memory Computing on Binary RRAM Crossbar.

Optimal Design Of Ddr3 Stt-Mram Memory

High performance and energy-efficient in-memory computing architecture based on SOT-MRAM

Architecture-circuit-technology Co-Optimization for Resistive Random Access Memory-Based Computation-in-memory Chips

ReSQM: Accelerating Database Operations Using ReRAM-Based Content Addressable Memory

In Memory Energy Application for Resistive Random Access Memory

Data Matching Engine for Efficient Big Data Searching Systems Using a RRAM Based Novel Computing Paradigm

Reconfigurable Processing in Memory Architecture Based on Spin Orbit Torque

CHIME: Energy-Efficient STT-RAM-based Concurrent Hierarchical In-Memory Processing

A hybrid memory built by SSD and DRAM to support in-memory Big Data analytics

STAR: Synthesis of Stateful Logic in RRAM Targeting High ARea Utilization

Efficient data management on 3D stacked memory for big data applications

A Novel ReRAM-based Processing-in-memory Architecture for Graph Computing.