Abstract:Emerging non-volatile memory (NVM) technologies enable data persistence at the main memory level at access speeds close to DRAM. In such persistent memories, memory writes need to be performed in strict order to satisfy storage consistency requirements and enable correct recovery from system crashes. Unfortunately, adhering to a strict order for writes to persistent memory significantly degrades system performance as it requires flushing dirty data blocks from CPU caches and waiting for their completion at the main memory in the order specified by the program. This paper introduces a new mechanism, called Loose-Ordering Consistency (LOC), that satisfies the ordering requirements of persistent memory writes at significantly lower performance degradation than state-of-the-art mechanisms. LOC consists of two key techniques. First, Eager Commit reduces the commit overhead for writes within a transaction by eliminating the need to perform a persistent commit record write at the end of a transaction. We do so by ensuring that we can determine the status of all committed transactions during recovery by storing necessary metadata information statically with blocks of data written to memory. Second, Speculative Persistence relaxes the ordering of writes between transactions by allowing writes to be speculatively written to persistent memory. A speculative write is made visible to software only after its associated transaction commits. To enable this, our mechanism requires the tracking of committed transaction ID and support for multi-versioning in the CPU cache. Our evaluations show that LOC reduces the average performance overhead of strict write ordering from 66.9% to 34.9% on a variety of workloads.

Persistent Data Layout in File Systems

Persistent Memory File Systems: A Survey

FlatFS: Flatten Hierarchical File System Namespace on Non-volatile Memories

Development of System Software on Non-Volatile Main Memory

A Survey on the Integration of NAND Flash Storage in the Design of File Systems and the Host Storage Software Stack

Research progress on non-volatile memory based storage system

Fat File System Design and Research

Exploiting Flat Namespace to Improve File System Metadata Performance on Ultra-fast, Byte-addressable NVMs

A Survey of Operating System Support for Persistent Memory.

NICFS:a File System Based on Persistent Memory and SmartNIC

Don't Persist All : Efficient Persistent Data Structures

DurableFS: A File System for Persistent Memory

Efficient storage management for aged file systems on persistent memory.

Mitigating Synchronous I/O Overhead in File Systems on Open-Channel SSDs

Revisiting the Architecture and System of Flash-Based Storage

A Heterogeneity-Aware Region-Level Data Layout for Hybrid Parallel File Systems.

Efficient Memory Management for Structured Data-Layout Optimization

Improving the Performance and Endurance of Persistent Memory with Loose-Ordering Consistency

Loose-Ordering Consistency for Persistent Memory.

Embedded File Systems for Large-scale Flash Memory

<i>SA-LSM</i>: Optimize Data Layout for LSM-tree Based Storage using Survival Analysis