Abstract:In-memory computing has inspired researchers to consider integrating large-capacity persistent memory (PM) into the main memory subsystem. However, several challenges still remain for providing an integration approach for DRAM-comparable PM on existing enterprise servers. Current commercial servers tend to feature multiple sockets with shared-memory NUMA organizations. Simply constructing a hybrid main memory architecture for these NUMA organizations requires considerable modifications of the system software. Another significant problem in these designs is the high latency of accessing PM on a remote socket, which results in performance degradation. To address these problems, we integrated PM as a memory-based model and as a storage-based model simultaneously on one commercial server, which offers a short-cut approach for enterprises to build commercial NUMA machines with large-capacity PM. In the memory-based model, rather than focusing on the persistence attribute, we propose an architecture that benefits managing the integrated PM and DRAM space in a unified manner and that facilitates bypassing vast modifications to the system software. We also present an adaptive mechanism that can automatically introduce a moderate amount of PM into the local socket to hinder access of a remote socket by the degree of memory pressure. In the storage-based model, under the condition of taking full advantage of the PM's persistence, we abstract a PM volume device and overcome the torn sector problem. To demonstrate the effectiveness of the proposed scheme, we design and implement Dapper, an adaptive persistent memory manager prototype. The experimental results show that, compared to typical memory management approaches, Dapper achieves performance improvements of 13.1 percent to 34.0 percent on average on Graph500 BFS_SSSP benchmarks and SPEC CPU2006 floating point workloads, respectively. Moreover, when deploying F2FS on our PM volume, we find that Dapper outperforms existing methods by 5.8 percent on tar and by 11.9 percent on untar.

Boosting Data Center Performance Via Intelligently Managed Multi-backend Disaggregated Memory

Characterizing and Optimizing Hybrid DRAM-PM Main Memory System with Application Awareness

HyFarM: Task Orchestration on Hybrid Far Memory for High Performance Per Bit

Dapper: an Adaptive Manager for Large-Capacity Persistent Memory

CXL over Ethernet: A Novel FPGA-based Memory Disaggregation Design in Data Centers

TH-DPMS: Design and Implementation of an RDMA-enabled Distributed Persistent Memory Storage System

Evaluating the Potential of Disaggregated Memory Systems for HPC applications

AGDM: An Adaptive Granularity Data Migration Strategy for Hybrid Memory Systems

ADSM: Adaptive Data Scheduling Method for Hybrid Memories in Distributed System

HAM: Hotspot-Aware Manager for Improving Communications With 3D-Stacked Memory

Hardware Memory Management for Future Mobile Hybrid Memory Systems

Design and Evaluation of a Rack-Scale Disaggregated Memory Architecture For Data Centers

The case for distributed shared-memory databases with RDMA-enabled memory disaggregation

Design and Simulation of Multi-tiered Heterogeneous Memory Architecture

Adaptive Memory Fusion: Towards Transparent, Agile Integration of Persistent Memory

Direct Distributed Memory Access for CMPs

Asynchronous Memory Access Unit: Exploiting Massive Parallelism for Far Memory Access

Memory Sharing for Handling Memory Overload on Physical Machines in Cloud Data Centers.

MIND: In-Network Memory Management for Disaggregated Data Centers

Gengar: An RDMA-based Distributed Hybrid Memory Pool