Abstract:Emerging Non-Volatile Memory (NVM) technologies promise much higher memory density and energy efficiency than DRAM, at the expense of higher read/write latency and limited write endurance. Hybrid memory systems composed of DRAM and NVM have the potential to provide very large capacity of main memory for in-memory key-value (K-V) stores. However, there remains challenges to directly deploy DRAM-based K-V stores in hybrid memory systems. The performance and energy efficiency of K-V stores on hybrid memory systems have not been fully explored yet. In this paper, we propose HMCached, an in-memory K-V store built on a hybrid DRAM/NVM system. HMCached utilizes an application-level data access counting mechanism to identify frequently-accessed (hotspot) objects (i.e., K-V pairs) in NVM, and migrates them to fast DRAM to reduce the costly NVM accesses. We also propose an NVM-friendly index structure to store the frequently-updated portion of object metadata in DRAM, and thus further mitigate the NVM accesses. Moreover, we propose a benefit-aware memory reassignment policy to address the slab calcification problem in slab-based K-V store systems, and significantly improve the benefit gain from the DRAM. We implement the proposed schemes with Memcached and evaluate it with Zipfian-like workloads. Experiment results show that HMCached significantly reduces NVM accesses by 70 percent compared to the vanilla Memcached running on a DRAM/NVM hybrid memory system without any optimizations, and improves application performance by up to 50 percent. Moreover, compared to a DRAM-only system, HMCached achieves 90 percent of performance and 46 percent reduction of energy consumption for realistic (read-intensive) workloads while significantly reducing the DRAM usage by 75 percent.

BF-Join: an Efficient Hash Join Algorithm for DRAM-NVM-Based Hybrid Memory Systems

Optimal Data Placement for Data-Centric Algorithms on NVM-Based Hybrid Memory

A Multi-hashing Index for hybrid DRAM-NVM memory systems

Massive Parallel Join in NUMA Architecture

Optimizing B + -Tree for Hybrid Memory with In-Node Hotspot Cache and Eadr Awareness

The Design and Implementation of a High-Performance Hybrid Memory File System

Utilizing the column imprints to accelerate no‐partitioning hash joins in large‐scale edge systems

Efficient Memory Management for NVM-Based Hybrid Memory Systems

RC-NVM: Enabling Symmetric Row and Column Memory Accesses for In-memory Databases

MBSA: a Lightweight and Flexible Storage Architecture for Virtual Machines

Optimal task allocation on non-volatile memory based hybrid main memory

Efficient Subgraph Matching on Non-volatile Memory.

Revisiting Persistent Hash Table Design for Commercial Non-Volatile Memory

Optimization of GPU-Based Main-Memory Hash Join

A hybrid memory architecture supporting fine-grained data migration

Task Allocation on Nonvolatile-Memory-Based Hybrid Main Memory

Hardware Memory Management for Future Mobile Hybrid Memory Systems

An Efficient File System for Hybrid In-Memory NVM and Block Devices

A Performance Evaluation of DRAM Access for In-Memory Databases

System Evaluation of the Intel Optane Byte-addressable NVM

Hotspot-Aware Hybrid Memory Management for In-Memory Key-Value Stores