Abstract:Massive off-chip accesses in GPUs are the main performance bottleneck, and we divided these accesses into three types: (1) Write, (2) Data-Read, and (3) Read-Only. Besides, We find that many writes are duplicate, and the duplication can be inter-dup and intra-dup. While inter-dup means different memory blocks are identical, and intra-dup means all the 4B elements in a line are the same. In this work, we propose a cache-assisted GPU memory deduplication architecture named CMD to reduce the off-chip accesses via utilizing the data duplication in GPU applications. CMD includes three key design contributions which aim to reduce the three kinds of accesses: (1) A novel GPU memory deduplication architecture that removes the inter-dup and inter-dup lines. As for the inter-dup detection, we reduce the extra read requests caused by the traditional read-verify hash process. Besides, we design several techniques to manage duplicate blocks. (2) We propose a cache-assisted read scheme to reduce the reads to duplicate data. When an L2 cache miss wants to read the duplicate block, if the reference block has been fetched to L2 and it is clean, we can copy it to the L2 missed block without accessing off-chip DRAM. As for the reads to intra-dup data, CMD uses the on-chip metadata cache to get the data. (3) When a cache line is evicted, the clean sectors in the line are invalidated while the dirty sectors are written back. However, most read-only victims are re-referenced from DRAM more than twice. Therefore, we add a full-associate FIFO to accommodate the read-only (it is also clean) victims to reduce the re-reference counts. Experiments show that CMD can decrease the off-chip accesses by 31.01%, reduce the energy by 32.78% and improve performance by 37.79%. Besides, CMD can improve the performance of memory-intensive workloads by 50.18%.

Uksm Swift Memory Deduplication Via Hierarchical And Adaptive Memory Region Distilling

AdaptMD: Balancing Space and Performance in NUMA Architectures with Adaptive Memory Deduplication

SEMMA: Secure Efficient Memory Management Approach in Virtual Environment.

User-guided Page Merging for Memory Deduplication in Serverless Systems

Towards Efficient Hugepage-aware Memory Deduplication

Hzmem: New Huge Page Allocator with Main Memory Compression.

Zweilous: A Decoupled and Flexible Memory Management Framework.

DASH: A duplication-aware flash cache architecture in virtualization environment

Low‐overhead inline deduplication for persistent memory

Try Managing Your Deduplication Fine-Grained-ly: A Multi-tiered and Dynamic SLA-Driven Deduplication Framework for Primary Storage.

SAUD: Semantics-Aware and Utility-Driven Deduplication Framework for Primary Storage.

CMD: A Cache-assisted GPU Memory Deduplication Architecture

A Memory Hierarchical Layer Assigning and Prefetching Technique to Overcome the Memory Performance/Energy Bottleneck

A Quantitative Approach for Adopting Disaggregated Memory in HPC Systems

A Novel Optimization Method to Improve De-duplication Storage System Performance

GLE-Dedup: A Globally–Locally Even Deduplication by Request-Aware Placement for Better Read Performance

Memory Power Optimization on Different Memory Address Mapping Schemas.

DPA: Demand-Based Partition and Data Allocation for Hybrid On-Chip Memory

Memory Power Optimisation on Low-Bit Multi-Access Cross Memory Address Mapping Schema

Exploring DRAM Cache Prefetching for Pooled Memory

Speed-Dedup: A New Deduplication Framework for Enhanced Performance and Reduced Overhead in Scale-Out Storage