Abstract:In-memory computing has inspired researchers to consider integrating large-capacity persistent memory (PM) into the main memory subsystem. However, several challenges still remain for providing an integration approach for DRAM-comparable PM on existing enterprise servers. Current commercial servers tend to feature multiple sockets with shared-memory NUMA organizations. Simply constructing a hybrid main memory architecture for these NUMA organizations requires considerable modifications of the system software. Another significant problem in these designs is the high latency of accessing PM on a remote socket, which results in performance degradation. To address these problems, we integrated PM as a memory-based model and as a storage-based model simultaneously on one commercial server, which offers a short-cut approach for enterprises to build commercial NUMA machines with large-capacity PM. In the memory-based model, rather than focusing on the persistence attribute, we propose an architecture that benefits managing the integrated PM and DRAM space in a unified manner and that facilitates bypassing vast modifications to the system software. We also present an adaptive mechanism that can automatically introduce a moderate amount of PM into the local socket to hinder access of a remote socket by the degree of memory pressure. In the storage-based model, under the condition of taking full advantage of the PM's persistence, we abstract a PM volume device and overcome the torn sector problem. To demonstrate the effectiveness of the proposed scheme, we design and implement Dapper, an adaptive persistent memory manager prototype. The experimental results show that, compared to typical memory management approaches, Dapper achieves performance improvements of 13.1 percent to 34.0 percent on average on Graph500 BFS_SSSP benchmarks and SPEC CPU2006 floating point workloads, respectively. Moreover, when deploying F2FS on our PM volume, we find that Dapper outperforms existing methods by 5.8 percent on tar and by 11.9 percent on untar.

Delaying Crash Consistency for Building A High-Performance Persistent Memory File System

HUNTER: Releasing Persistent Memory Write Performance with A Novel PM-DRAM Collaboration Architecture

Optimizing synchronization mechanism for block-based file systems using persistent memory

HTMFS: Strong Consistency Comes for Free with Hardware Transactional Memory in Persistent Memory File Systems

HMFS: A Hybrid In-Memory File System with Version Consistency

A Unified Framework for Designing High Performance In-Memory and Hybrid Memory File Systems

TPFS: A High-Performance Tiered File System for Persistent Memories and Disks.

Persistent Memory Objects: Fast and Easy Crash Consistency for Persistent Memory

Designing an efficient persistent in-memory file system

Adaptive Memory Fusion: Towards Transparent, Agile Integration of Persistent Memory

HMVFS: A Hybrid Memory Versioning File System

TH-DPMS: Design and Implementation of an RDMA-enabled Distributed Persistent Memory Storage System

Forca: Fast and Atomic Remote Direct Access to Persistent Memory.

HMVFS: A Versioning File System on DRAM/NVM Hybrid Memory.

DMA-assisted I/O for Persistent Memory

The Design and Implementation of a High-Performance Hybrid Memory File System

Optimizing File Systems on Heterogeneous Memory by Integrating DRAM Cache with Virtual Memory Management.

Ethane: an Asymmetric File System for Disaggregated Persistent Memory.

Efficient storage management for aged file systems on persistent memory.

HiNFS: A Persistent Memory File System with Both Buffering and Direct-Access.

Dapper: an Adaptive Manager for Large-Capacity Persistent Memory