Abstract:Load balancing is critical for storage clusters to scale out and improve performance under skewed workloads. Multi-layer caching mechanism is proposed to improve load balancing for large-scale storage systems. However, because dynamic random-access memory (DRAM)-based cache is limited by capacity, volatility and chip cost, non-volatile devices, such as flash-based SSD and 3D Xpoint, are gradually being deployed as caches in large-scale storage systems. The emerging non-volatile memories such as PCM and ReRAM are expected to replace DRAM as caches in the future. Experimental evaluations show that while multi-layer caching mechanism works well for DRAM-based caching, it leads to write imbalance under mixed read-write workloads for non-volatile memory (NVM)-based caching. Existing mechanisms for DRAM-based cache do not consider the limited endurance and read-write asymmetry issues that are associated with NVM-based caches. Thus, how to effectively utilize the physical characteristics of NVMs and extend their lifespans has become the main challenge of NVM-based caching systems. In this study, we present NVMCache, an NVM-based multilayer caching mechanism. NVMCache introduces a wear-balancing scheme to avoid local intensive write operations to balance both load and wear. NVMCache aims to 1) ensure I/O load balancing and avoid access bottlenecks for large-scale storage systems, 2) take advantage of NVM's read/write asymmetry and prioritize access to reduce write-request blocking and improve overall access performance, and 3) extend the overall service lifetime of the NVM-based cache. The experimental results show that under different workloads, compared with DistCache, the state-of-the-art multi-layer caching mechanism, NVMCache improves throughput by a maximum of 10% and reduces wear imbalance by a maximum of 80%.

Lowering Latency of Embedded Memory by Exploiting In-Cell Victim Cache Hierarchy Based on Emerging Multi-Level Memory Devices

Enhancing Lifetime and Performance of MLC NVM Caches using Embedded Trace buffers

Network Victim Cache: Leveraging Network-on-Chip for Managing Shared Caches in Chip Multiprocessors

Exploiting Cross-Layer Hotness Identification To Improve Flash Memory System Performance

Victor: A Variation-resilient Approach Using Cell-Clustered Charge-domain computing for High-density High-throughput MLC CiM

Write-back Aware Shared Last-Level Cache Management for Hybrid Main Memory

Energy, Latency, and Lifetime Improvements in MLC NVM with Enhanced WOM Code.

MScache: A buffer management scheme based on page-level address mapping for NAND-flash SSD

Adaptive Circuit Approaches to Low-Power Multi-Level/Cell FeFET Memory

Exploit Asymmetric Error Rates of Cell States to Improve the Performance of Flash Memory Storage Systems

Exploiting Latency Variation for Access Conflict Reduction of NAND Flash Memory

NVMCache: Wear-Aware Load Balancing NVM-based Caching for Large-Scale Storage Systems

Minimizing Cell-to-cell Interference by Exploiting Differential Bit Impact Characteristics of Scaled MLC NAND Flash Memories

A Study on Performance and Power Efficiency of Dense Non-Volatile Caches in Multi-Core Systems

Latency Variation Aware Read Performance Optimization on 3D High Density NAND Flash Memory.

DLBF: A Low Overhead Wear Leveling Algorithm for Embedded Systems with Hybrid Memory

Read Latency Variation Aware Performance Optimization on High-Density NAND Flash Based Storage Systems

Wear Relief for High-Density Phase Change Memory Through Cell Morphing Considering Process Variation

DLV: Exploiting Device Level Latency Variations for Performance Improvement on Flash Memory Storage Systems

Exploiting Narrow-Width Values for Improving Non-Volatile Cache Lifetime

A Method for Hiding the Increased Non-Volatile Cache Read Latency