Abstract:Non- Volatile Memory (NVM) offers low-latency, non-volatility, and byte-addressability, positioning it as a highly promising device for database performance enhancement. Cur-rent research primarily focuses on utilizing LSM-Tree in con-junction with NVM to reduce write amplification and alleviate write stall issues. However, the comprehensive potential of NVM in simultaneously augmenting both read and write performances remains underexplored. And the previous NVM-enhanced LSM-Tree also ignores the sensitivity of NVM to small-grained random reads and writes, which we believe is the key to further improving read and write performance. To address these issues, we propose BushStore, an innovative LSM-Tree variant specifically optimized for NVM. BushStore is designed with a three-level architecture, where the higher levels of BushStore contain a group of immutable, non-clustered B+Trees, replacing traditional SSTables. By storing the non-leaf nodes in the DRAM and the leaf nodes in NVM, and separating the data pages from the indexes, these B+Trees are able to exhibit high performance for diverse read and write operations. Our approach encompasses four key techniques to significantly boost system efficiency: First, we develop novel data structures that localize read/write operations to confined NVM areas, enhancing access speed. Second, we optimize the key-value data handling during flushing and compaction phases, leveraging the superior scanning and sequantial writing capabilities of B+Trees to ex-pedite write and compaction processes. Third, we dynamically adjust the B+Tree sizes, enabling a balanced and optimized flushing and compaction process, thereby improving overall write performance. Fourth, we implement a lazy-delete Cuckoo filtering and lazy-persistent allocation strategy to accelerate query and compaction processes. Evaluations show that BushStore exhibits high performance and scalability under synthetic and real work-loads, and achieves an average performance improvement of 3.3x in random write throughput and 4.3x in random read throughput compared to the state-of-the-art MioDB system.

MetaWBC: POSIX-Compliant Metadata Write-Back Caching for Distributed File Systems

DEAM：Decoupled, Expressive, Area-Efficient Metadata Cache

MetaCache: Efficient Metadata Caching in Linux file system

BushStore: Efficient B+Tree Group Indexing for LSM-Tree in Non-Volatile Memory

Optimizing synchronization mechanism for block-based file systems using persistent memory

NVMM-Oriented Hierarchical Persistent Client Caching for Lustre

Design and Implementation of an Asymmetric Block-Based Parallel File System

CFS: Scaling Metadata Service for Distributed File System Via Pruned Scope of Critical Sections

MBSA: a Lightweight and Flexible Storage Architecture for Virtual Machines

An Efficient File System for Hybrid In-Memory NVM and Block Devices

Using Memcached to Promote Read Throughput in Massive Small-File Storage System

AsyncFS: Metadata Updates Made Asynchronous for Distributed Filesystems with In-Network Coordination

ICCG: low-cost and efficient consistency with adaptive synchronization for metadata replication

A Highly Reliable Metadata Service for Large-Scale Distributed File Systems

Optimizing File Systems on Heterogeneous Memory by Integrating DRAM Cache with Virtual Memory Management.

Metadata Optimization Method for Distributed File System Based on SSD Feature

Explicit Data Correlations-Directed Metadata Prefetching Method in Distributed File Systems

NVPC: A Transparent NVM Page Cache

MetaFlow: A Scalable Metadata Lookup Service for Distributed File Systems in Data Centers

Scmfs: A File System For Storage Class Memory And Its Extensions

SingularFS: A Billion-Scale Distributed File System Using a Single Metadata Server.