Abstract:Persistent memory allocation is a fundamental building block for developing high-performance and in-memory applications. Existing persistent memory allocators suffer from many performance issues. First, they may introduce repeated cache line flushes and small random accesses in persistent memory for their poor heap metadata management. Second, they use static slab segregation resulting in a dramatic increase in memory consumption when allocation request size is changed. Third, they are not aware of NUMA effect, leading to remote persistent memory accesses in memory allocation and deallocation processes. In this paper, we design a novel allocator, named PMAlloc, to solve the above issues simultaneously. (1) PMAlloc eliminates cache line reflushes by mapping contiguous data blocks in slabs to interleaved metadata entries stored in different cache lines. (2) It writes small metadata units to a persistent bookkeeping log in a sequential pattern to remove random heap metadata accesses in persistent memory. (3) Instead of using static slab segregation, it supports slab morphing, which allows slabs to be transformed between size classes to significantly improve slab usage. (4) It uses a local-first allocation policy to avoid allocating remote memory blocks. And it supports a two-phase deallocation mechanism including recording and synchronization to minimize the number of remote memory access in the deallocation. PMAlloc is complementary to the existing consistency models. Results on 6 benchmarks demonstrate that PMAlloc improves the performance of state-of-the-art persistent memory allocators by up to 6.4x and 57x for small and large allocations, respectively. PMAlloc with NUMA optimizations brings a 2.9x speedup in multi-socket evaluation and is up to 36x faster than other persistent memory allocators. Using PMAlloc reduces memory usage by up to 57.8%. Besides, we integrate PMAlloc in a persistent FPTree. Compared to the state-of-the-art allocators, PMAlloc improves the performance of this application by up to 3.1x.

Exploring Data Placement in Racetrack Memory Based Scratchpad Memory.

Performance Analysis on Structure of Racetrack Memory

Exploring Main Memory Design Based on Racetrack Memory Technology.

Low-Power Low-Latency Data Allocation for Hybrid Scratch-Pad Memory

Quantitative modeling of racetrack memory, a tradeoff among area, performance, and power

From Device to System: Cross-layer Design Exploration of Racetrack Memory

Branch-aware data variable allocation for energy optimization of hybrid SRAM+NVM SPM☆

Designing Scratchpad Memory Architecture with Emerging STT-RAM Memory Technologies

Redesign the Memory Allocator for Non-Volatile Main Memory.

PMAlloc: A Holistic Approach to Improving Persistent Memory Allocation

MBSA: a Lightweight and Flexible Storage Architecture for Virtual Machines

Efficient Utilization of Scratch-Pad Memory Banks

Hi-fi Playback

Perspectives of Racetrack Memory for Large-Capacity On-Chip Memory: from Device to System

DPA: Demand-Based Partition and Data Allocation for Hybrid On-Chip Memory

Adaptive Placement and Migration Policy for an STT-RAM-based Hybrid Cache

Optimizing Placement of Heap Memory Objects in Energy-Constrained Hybrid Memory Systems

Performance-Centric Optimization for Racetrack Memory Based Register File on GPUs

Stochastic Modeling of Hybrid Cache Systems

Memory That Never Forgets: Emerging Nonvolatile Memory and the Implication for Architecture Design

Demystifying the Performance of HPC Scientific Applications on NVM-based Memory Systems