Abstract:Persistent memory allocation is a fundamental building block for developing high-performance and in-memory applications. Existing persistent memory allocators suffer from many performance issues. First, they may introduce repeated cache line flushes and small random accesses in persistent memory for their poor heap metadata management. Second, they use static slab segregation resulting in a dramatic increase in memory consumption when allocation request size is changed. Third, they are not aware of NUMA effect, leading to remote persistent memory accesses in memory allocation and deallocation processes. In this paper, we design a novel allocator, named PMAlloc, to solve the above issues simultaneously. (1) PMAlloc eliminates cache line reflushes by mapping contiguous data blocks in slabs to interleaved metadata entries stored in different cache lines. (2) It writes small metadata units to a persistent bookkeeping log in a sequential pattern to remove random heap metadata accesses in persistent memory. (3) Instead of using static slab segregation, it supports slab morphing, which allows slabs to be transformed between size classes to significantly improve slab usage. (4) It uses a local-first allocation policy to avoid allocating remote memory blocks. And it supports a two-phase deallocation mechanism including recording and synchronization to minimize the number of remote memory access in the deallocation. PMAlloc is complementary to the existing consistency models. Results on 6 benchmarks demonstrate that PMAlloc improves the performance of state-of-the-art persistent memory allocators by up to 6.4x and 57x for small and large allocations, respectively. PMAlloc with NUMA optimizations brings a 2.9x speedup in multi-socket evaluation and is up to 36x faster than other persistent memory allocators. Using PMAlloc reduces memory usage by up to 57.8%. Besides, we integrate PMAlloc in a persistent FPTree. Compared to the state-of-the-art allocators, PMAlloc improves the performance of this application by up to 3.1x.

Memory Sharing for Handling Memory Overload on Physical Machines in Cloud Data Centers.

Thoth: Provisioning Over-Committed Memory Resource with Differentiated QoS in Public Clouds

A Way to Improve the Performance of Integrated Real-Time Monitoring System in Power Grid by Distributed Shared Memory Technology

SEMMA: Secure Efficient Memory Management Approach in Virtual Environment.

Hzmem: New Huge Page Allocator with Main Memory Compression.

Memory Affinity: Balancing Performance, Power, Thermal and Fairness for Multi-core Systems

Design and Evaluation of a Rack-Scale Disaggregated Memory Architecture For Data Centers

Evaluating the Potential of Disaggregated Memory Systems for HPC applications

A Quantitative Approach for Adopting Disaggregated Memory in HPC Systems

MIND: In-Network Memory Management for Disaggregated Data Centers

Efficient Orchestration of Host and Remote Shared Memory for Memory Intensive Workloads

Contiguitas: The Pursuit of Physical Memory Contiguity in Data Centers

Flexible Swapping for the Cloud

Megalloc: Fast Distributed Memory Allocator for NVM-Based Cluster

PMAlloc: A Holistic Approach to Improving Persistent Memory Allocation

Workload Behavior Driven Memory Subsystem Design for Hyperscale

HMM-V: Heterogeneous Memory Management for Virtualization

Revamping Storage Class Memory With Hardware Automated Memory-Over-Storage Solution

Assessing Intel's Memory Bandwidth Allocation for resource limitation in real-time systems

A distributed paging RAM grid system for wide-area memory sharing.