Abstract:Today's computing systems require moving data back-and-forth between computing resources (e.g., CPUs, GPUs, accelerators) and off-chip main memory so that computation can take place on the data. Unfortunately, this data movement is a major bottleneck for system performance and energy consumption. One promising execution paradigm that alleviates the data movement bottleneck in modern and emerging applications is processing-in-memory (PIM), where the cost of data movement to/from main memory is reduced by placing computation capabilities close to memory. Naively employing PIM to accelerate data-intensive workloads can lead to sub-optimal performance due to the many design constraints PIM substrates impose. Therefore, many recent works co-design specialized PIM accelerators and algorithms to improve performance and reduce the energy consumption of (i) applications from various application domains; and (ii) various computing environments, including cloud systems, mobile systems, and edge devices. We showcase the benefits of co-designing algorithms and hardware in a way that efficiently takes advantage of the PIM paradigm for two modern data-intensive applications: (1) machine learning inference models for edge devices and (2) hybrid transactional/analytical processing databases for cloud systems. We follow a two-step approach in our system design. In the first step, we extensively analyze the computation and memory access patterns of each application to gain insights into its hardware/software requirements and major sources of performance and energy bottlenecks in processor-centric systems. In the second step, we leverage the insights from the first step to co-design algorithms and hardware accelerators to enable high-performance and energy-efficient data-centric architectures for each application.

In-Memory Database Systems - A Paradigm Shift

In-Memory Big Data Management and Processing: A Survey

The Performance Survey of in Memory Database

In-memory big data analytics under space constraints using dynamic programming.

In-Memory Computing: Advances and Prospects

HMDS : A Novel View of Data System Based on Hybrid Memory Architecture with Non-Volatility

In-Memory Computing: The Next-Generation AI Computing Paradigm

A Performance Evaluation of DRAM Access for In-Memory Databases

An Overview of In-memory Processing with Emerging Non-volatile Memory for Data-intensive Applications

Processing Data Where It Makes Sense: Enabling In-Memory Computation

MemepiC: Towards a Unified In-Memory Big Data Management System

New Dimension Value Introduction for In-Memory What-If Analysis

Computing In-Memory, Revisited

Domain-Specific STT-MRAM-Based In-Memory Computing: A Survey

Device and Circuit Architectures for In‐Memory Computing

“Anti-Caching”-based elastic memory management for Big Data

A Survey of Resource Management for Processing-in-Memory and Near-Memory Processing Architectures

In-memory Computing to Break the Memory Wall

Heterogeneous Data-Centric Architectures for Modern Data-Intensive Applications: Case Studies in Machine Learning and Databases

Lessons learned from the early performance evaluation of Intel Optane DC Persistent Memory in DBMS

In-Memory Mirroring: Cloning Without Reading