Abstract:Persistent memory allocation is a fundamental building block for developing high-performance and in-memory applications. Existing persistent memory allocators suffer from many performance issues. First, they may introduce repeated cache line flushes and small random accesses in persistent memory for their poor heap metadata management. Second, they use static slab segregation resulting in a dramatic increase in memory consumption when allocation request size is changed. Third, they are not aware of NUMA effect, leading to remote persistent memory accesses in memory allocation and deallocation processes. In this paper, we design a novel allocator, named PMAlloc, to solve the above issues simultaneously. (1) PMAlloc eliminates cache line reflushes by mapping contiguous data blocks in slabs to interleaved metadata entries stored in different cache lines. (2) It writes small metadata units to a persistent bookkeeping log in a sequential pattern to remove random heap metadata accesses in persistent memory. (3) Instead of using static slab segregation, it supports slab morphing, which allows slabs to be transformed between size classes to significantly improve slab usage. (4) It uses a local-first allocation policy to avoid allocating remote memory blocks. And it supports a two-phase deallocation mechanism including recording and synchronization to minimize the number of remote memory access in the deallocation. PMAlloc is complementary to the existing consistency models. Results on 6 benchmarks demonstrate that PMAlloc improves the performance of state-of-the-art persistent memory allocators by up to 6.4x and 57x for small and large allocations, respectively. PMAlloc with NUMA optimizations brings a 2.9x speedup in multi-socket evaluation and is up to 36x faster than other persistent memory allocators. Using PMAlloc reduces memory usage by up to 57.8%. Besides, we integrate PMAlloc in a persistent FPTree. Compared to the state-of-the-art allocators, PMAlloc improves the performance of this application by up to 3.1x.

Stamp-it: A more Thread-efficient, Concurrent Memory Reclamation Scheme in the C++ Memory Model

A new and five older Concurrent Memory Reclamation Schemes in Comparison (Stamp-it)

Reclaiming memory for lock-free data structures: there has to be a better way

Turning Manual Concurrent Memory Reclamation into Automatic Reference Counting

Concurrent Reference Counting and Resource Management in Wait-free Constant Time

Are Your Epochs Too Epic? Batch Free Can Be Harmful

StarMalloc: A Formally Verified, Concurrent, Performant, and Security-Oriented Memory Allocator

Releasing Memory with Optimistic Access: A Hybrid Approach to Memory Reclamation and Allocation in Lock-Free Programs

VBR: Version Based Reclamation

Every Data Structure Deserves Lock-Free Memory Reclamation

Efficient Hardware Primitives for Immediate Memory Reclamation in Optimistic Data Structures

A Non-blocking Buddy System for Scalable Memory Allocation on Multi-core Machines

Fast, Multicore-Scalable, Low-Fragmentation Memory Allocation through Large Virtual Memory and Global Data Structures

LockillerTM: Enhancing Performance Lower Bounds in Best-Effort Hardware Transactional Memory

C11Tester: A Race Detector for C/C++ Atomics Technical Report

Throughput-oriented GPU memory allocation

Cache-Aware Lock-Free Concurrent Hash Tries

Separation of concerning things: a simpler basis for defining and programming with the C/C++ memory model (extended version)

PMAlloc: A Holistic Approach to Improving Persistent Memory Allocation

SJMalloc: the security-conscious, fast, thread-safe and memory-efficient heap allocator

Memory Reclamation for Recoverable Mutual Exclusion