Abstract:Non- Volatile Memory (NVM) offers low-latency, non-volatility, and byte-addressability, positioning it as a highly promising device for database performance enhancement. Cur-rent research primarily focuses on utilizing LSM-Tree in con-junction with NVM to reduce write amplification and alleviate write stall issues. However, the comprehensive potential of NVM in simultaneously augmenting both read and write performances remains underexplored. And the previous NVM-enhanced LSM-Tree also ignores the sensitivity of NVM to small-grained random reads and writes, which we believe is the key to further improving read and write performance. To address these issues, we propose BushStore, an innovative LSM-Tree variant specifically optimized for NVM. BushStore is designed with a three-level architecture, where the higher levels of BushStore contain a group of immutable, non-clustered B+Trees, replacing traditional SSTables. By storing the non-leaf nodes in the DRAM and the leaf nodes in NVM, and separating the data pages from the indexes, these B+Trees are able to exhibit high performance for diverse read and write operations. Our approach encompasses four key techniques to significantly boost system efficiency: First, we develop novel data structures that localize read/write operations to confined NVM areas, enhancing access speed. Second, we optimize the key-value data handling during flushing and compaction phases, leveraging the superior scanning and sequantial writing capabilities of B+Trees to ex-pedite write and compaction processes. Third, we dynamically adjust the B+Tree sizes, enabling a balanced and optimized flushing and compaction process, thereby improving overall write performance. Fourth, we implement a lazy-delete Cuckoo filtering and lazy-persistent allocation strategy to accelerate query and compaction processes. Evaluations show that BushStore exhibits high performance and scalability under synthetic and real work-loads, and achieves an average performance improvement of 3.3x in random write throughput and 4.3x in random read throughput compared to the state-of-the-art MioDB system.

Efficient novel memory index structure processing method

BushStore: Efficient B+Tree Group Indexing for LSM-Tree in Non-Volatile Memory

FlashSkipList

A prefetching indexing scheme for in-memory database systems

PI : a Parallel in-memory skip list based Index

S3: A Scalable In-memory Skip-List Index for Key-Value Store.

Fast, Incremental Inverted Indexing in Main Memory for Web-Scale Collections

An Efficient and Compact Indexing Scheme for Large-Scale Data Store.

Efficient indexing method for optimizing leaf node merging operation

Path Prefetching: Accelerating Index Searches for In-Memory Databases

Distributed scheduling and storage scheme based on LSM-OCTree for spatiotemporal stream

PhaST: Hierarchical Concurrent Log-Free Skip List for Persistent Memory

A Comprehensive Performance Evaluation of Modern In-Memory Indices

Search-in-Memory: Reliable, Versatile, and Efficient Data Matching in SSD's NAND Flash Memory Chip for Data Indexing Acceleration

The HV-tree: a memory hierarchy aware version index

Key value data indexing method of workload self-adaptive single-layer LSMT

Exploration and optimization of novel replacement and prefetching strategies for inefficiencies of advanced MRAM-based hybrid cache systems

Data layout optimization based on the spatio-temporal model of field access

A Novel Cache Organization for Tiled Chip Multiprocessor

Efficient Execution of Multiple Queries on Deep Memory Hierarchy

Fast and Scalable Memristive In-Memory Sorting with Column-Skipping Algorithm