Abstract:Massive off-chip accesses in GPUs are the main performance bottleneck, and we divided these accesses into three types: (1) Write, (2) Data-Read, and (3) Read-Only. Besides, We find that many writes are duplicate, and the duplication can be inter-dup and intra-dup. While inter-dup means different memory blocks are identical, and intra-dup means all the 4B elements in a line are the same. In this work, we propose a cache-assisted GPU memory deduplication architecture named CMD to reduce the off-chip accesses via utilizing the data duplication in GPU applications. CMD includes three key design contributions which aim to reduce the three kinds of accesses: (1) A novel GPU memory deduplication architecture that removes the inter-dup and inter-dup lines. As for the inter-dup detection, we reduce the extra read requests caused by the traditional read-verify hash process. Besides, we design several techniques to manage duplicate blocks. (2) We propose a cache-assisted read scheme to reduce the reads to duplicate data. When an L2 cache miss wants to read the duplicate block, if the reference block has been fetched to L2 and it is clean, we can copy it to the L2 missed block without accessing off-chip DRAM. As for the reads to intra-dup data, CMD uses the on-chip metadata cache to get the data. (3) When a cache line is evicted, the clean sectors in the line are invalidated while the dirty sectors are written back. However, most read-only victims are re-referenced from DRAM more than twice. Therefore, we add a full-associate FIFO to accommodate the read-only (it is also clean) victims to reduce the re-reference counts. Experiments show that CMD can decrease the off-chip accesses by 31.01%, reduce the energy by 32.78% and improve performance by 37.79%. Besides, CMD can improve the performance of memory-intensive workloads by 50.18%.

CKSM: an Efficient Memory Deduplication Method for Container-based Cloud Computing Systems

Uksm Swift Memory Deduplication Via Hierarchical And Adaptive Memory Region Distilling

Cmd: Classification-Based Memory Deduplication Through Page Access Characteristics

Leveraging Array Mapped Tries in KSM for Lightweight Memory Deduplication

Static Memory Deduplication for Performance Optimization in Cloud Computing

Coordinate Memory Deduplication and Partition for Improving Performance in Cloud Computing

SEMMA: Secure Efficient Memory Management Approach in Virtual Environment.

User-guided Page Merging for Memory Deduplication in Serverless Systems

A Delayed Container Organization Approach to Improve Restore Speed for Deduplication Systems.

Smartmd: A High Performance Deduplication Engine With Mixed Pages

Loc-K: A Spatial Locality-Based Memory Deduplication Scheme with Prediction on K-Step Locations

Towards High Performance and Efficient Memory Deduplication Via Mixed Pages

DASH: A duplication-aware flash cache architecture in virtualization environment

AdaptMD: Balancing Space and Performance in NUMA Architectures with Adaptive Memory Deduplication

The Design and Optimization of Memory Ballooning in SEV Confidential Virtual Machines

Hzmem: New Huge Page Allocator with Main Memory Compression.

CMD: A Cache-assisted GPU Memory Deduplication Architecture

Towards Efficient Hugepage-aware Memory Deduplication

Energy-Aware Data Allocation with Hybrid Memory for Mobile Cloud Systems

Ada-copy: An Adaptive Memory Copy Strategy for Virtual Machine Live Migration

Flexible Swapping for the Cloud