Abstract:In-memory computing has inspired researchers to consider integrating large-capacity persistent memory (PM) into the main memory subsystem. However, several challenges still remain for providing an integration approach for DRAM-comparable PM on existing enterprise servers. Current commercial servers tend to feature multiple sockets with shared-memory NUMA organizations. Simply constructing a hybrid main memory architecture for these NUMA organizations requires considerable modifications of the system software. Another significant problem in these designs is the high latency of accessing PM on a remote socket, which results in performance degradation. To address these problems, we integrated PM as a memory-based model and as a storage-based model simultaneously on one commercial server, which offers a short-cut approach for enterprises to build commercial NUMA machines with large-capacity PM. In the memory-based model, rather than focusing on the persistence attribute, we propose an architecture that benefits managing the integrated PM and DRAM space in a unified manner and that facilitates bypassing vast modifications to the system software. We also present an adaptive mechanism that can automatically introduce a moderate amount of PM into the local socket to hinder access of a remote socket by the degree of memory pressure. In the storage-based model, under the condition of taking full advantage of the PM's persistence, we abstract a PM volume device and overcome the torn sector problem. To demonstrate the effectiveness of the proposed scheme, we design and implement Dapper, an adaptive persistent memory manager prototype. The experimental results show that, compared to typical memory management approaches, Dapper achieves performance improvements of 13.1 percent to 34.0 percent on average on Graph500 BFS_SSSP benchmarks and SPEC CPU2006 floating point workloads, respectively. Moreover, when deploying F2FS on our PM volume, we find that Dapper outperforms existing methods by 5.8 percent on tar and by 11.9 percent on untar.

Efficient Distributed Memory Management with RDMA and Caching

Building Expressive and Area-Efficient Directories with Hybrid Representation and Adaptive Multi-Granular Tracking

Megalloc: Fast Distributed Memory Allocator for NVM-Based Cluster

Direct Distributed Memory Access for CMPs

Rcmp: Reconstructing RDMA-Based Memory Disaggregation via CXL

Dapper: an Adaptive Manager for Large-Capacity Persistent Memory

TH-DPMS: Design and Implementation of an RDMA-enabled Distributed Persistent Memory Storage System

DArray: A High Performance RDMA-Based Distributed Array.

Characterizing and Optimizing Remote Persistent Memory with RDMA and NVM.

Exploring Efficient Architectures On Remote In-Memory Nvm Over Rdma

MemepiC: Towards a Unified In-Memory Big Data Management System

A distributed paging RAM grid system for wide-area memory sharing.

HAM: Hotspot-Aware Manager for Improving Communications With 3D-Stacked Memory

Optimizing Distributed Systems with Remote Direct Memory Access

Scaling out NUMA-Aware Applications with RDMA-Based Distributed Shared Memory

Exploring DRAM Cache Prefetching for Pooled Memory

Partial Failure Resilient Memory Management System for (Cxl-Based) Distributed Shared Memory

DeACT: Architecture-Aware Virtual Memory Support for Fabric Attached Memory Systems

Revitalizing the Forgotten On-Chip DMA to Expedite Data Movement in NVM-based Storage Systems

MC-RDMA: Improving Replication Performance of RDMA-based Distributed Systems with Reliable Multicast Support

Demystifying the Performance of HPC Scientific Applications on NVM-based Memory Systems