Abstract:Non- Volatile Memory (NVM) offers low-latency, non-volatility, and byte-addressability, positioning it as a highly promising device for database performance enhancement. Cur-rent research primarily focuses on utilizing LSM-Tree in con-junction with NVM to reduce write amplification and alleviate write stall issues. However, the comprehensive potential of NVM in simultaneously augmenting both read and write performances remains underexplored. And the previous NVM-enhanced LSM-Tree also ignores the sensitivity of NVM to small-grained random reads and writes, which we believe is the key to further improving read and write performance. To address these issues, we propose BushStore, an innovative LSM-Tree variant specifically optimized for NVM. BushStore is designed with a three-level architecture, where the higher levels of BushStore contain a group of immutable, non-clustered B+Trees, replacing traditional SSTables. By storing the non-leaf nodes in the DRAM and the leaf nodes in NVM, and separating the data pages from the indexes, these B+Trees are able to exhibit high performance for diverse read and write operations. Our approach encompasses four key techniques to significantly boost system efficiency: First, we develop novel data structures that localize read/write operations to confined NVM areas, enhancing access speed. Second, we optimize the key-value data handling during flushing and compaction phases, leveraging the superior scanning and sequantial writing capabilities of B+Trees to ex-pedite write and compaction processes. Third, we dynamically adjust the B+Tree sizes, enabling a balanced and optimized flushing and compaction process, thereby improving overall write performance. Fourth, we implement a lazy-delete Cuckoo filtering and lazy-persistent allocation strategy to accelerate query and compaction processes. Evaluations show that BushStore exhibits high performance and scalability under synthetic and real work-loads, and achieves an average performance improvement of 3.3x in random write throughput and 4.3x in random read throughput compared to the state-of-the-art MioDB system.

Adaptive Lazy Compaction with High Stability and Low Latency for Data-Intensive Systems

LDC: A Lower-Level Driven Compaction Method to Optimize SSD-Oriented Key-Value Stores

Adaptive Lower-Level Driven Compaction to Optimize LSM-Tree Key-Value Stores

BushStore: Efficient B+Tree Group Indexing for LSM-Tree in Non-Volatile Memory

<i>SA-LSM</i>: Optimize Data Layout for LSM-tree Based Storage using Survival Analysis

FPGA-Accelerated Compactions for LSM-based Key-Value Store.

Reducing Write Amplification of LSM-Tree with Block-Grained Compaction

SA-LSM

A Light-weight Compaction Tree to Reduce I / O Amplification toward Efficient Key-Value Stores

Elastic and Stable Compaction for LSM-tree: A FaaS-Based Approach on TerarkDB

Building Efficient Key-Value Stores Via a Lightweight Compaction Tree

Building A Fast and Efficient LSM-tree Store by Integrating Local Storage with Cloud Storage

MyWAL: Performance Optimization by Removing Redundant Input/output Stack in Key-Value Store

iKnowFirst: An Efficient DPU-assisted Compaction for LSM-Tree-based Key-Value Stores

Collaborative Compaction Optimization System Using Near-Data Processing for LSM-tree-based Key-Value Stores

Time-tired compaction: An elastic compaction scheme for LSM-tree based time-series database

Constructing and Analyzing the LSM Compaction Design Space (Updated Version)

CaaS-LSM: Compaction-as-a-Service for LSM-based Key-Value Stores in Storage Disaggregated Infrastructure

Co-KV: A Collaborative Key-Value Store Using Near-Data Processing to Improve Compaction for the LSM-tree.

vLSM: Low tail latency and I/O amplification in LSM-based KV stores

On Reducing Space Amplification with Multi-Column Compaction in Apache IoTDB