Abstract:Commercial search engines generally maintain hundreds of thousands of machines equipped with large sized DRAM in order to process huge volume of user queries with fast responsiveness, which incurs high hardware cost since DRAM is very expensive. Recently, NVM Optane SSD has been considered as a promising underlying storage device due to its price advantage over DRAM and speed advantage over traditional slow block devices. However, to achieve a comparable efficiency performance with in-memory index, applying NVM to both latency and I/O bandwidth critical applications such as search engines still face non-trivial challenges, because NVM has much lower I/O speed and bandwidth compared to DRAM. In this paper, we propose an NVM SSD-optimized query processing framework, aiming to address both the latency and bandwidth issues of using NVM in search engines. First, we propose a pipelined query processing methodology which significantly reduces the I/O waiting time by fine-grained overlapping of the computation and I/O operations. Second, we propose a cache-aware query reordering algorithm which enables queries sharing more data to be processed adjacently so that the I/O traffic is minimized. Third, we propose a data prefetching mechanism which reduces the extra thread waiting time due to data sharing and improves bandwidth utilization. Moreover, we propose intra-query parallel mechanisms for long-tail queries, including query subtask scheduling, heap concurrent access strategy, query parallelism prediction and adaptive pipelining. Extensive experimental studies show that our framework significantly outperforms the state-of-the-art baselines, which obtains comparable processing latency and throughput with DRAM while using much less space in both inter-query and intra-query parallel scenarios.

Energy-efficient SQL query exploiting RRAM-based process-in-memory structure

Bidirectional Database Storage and SQL Query Exploiting RRAM-Based Process-in-Memory Structure

Electrothermal Simulation of Resistive Random Access Memory(RRAM) Array Using Finite Difference Method

Energy Efficient Computing with High-Density, Field-Free STT-Assisted SOT-MRAM (SAS-MRAM)

A Performance Evaluation of DRAM Access for In-Memory Databases

HyVE: Hybrid Vertex-Edge Memory Hierarchy for Energy-Efficient Graph Processing.

Architecting Heterogeneous Memory Systems with DRAM Technology Only: A Case Study on Relational Database.

An Energy-Efficient Matrix Multiplication Accelerator by Distributed In-Memory Computing on Binary RRAM Crossbar.

Data Matching Engine for Efficient Big Data Searching Systems Using a RRAM Based Novel Computing Paradigm

In Memory Energy Application for Resistive Random Access Memory

High performance and energy-efficient in-memory computing architecture based on SOT-MRAM

Energy-Efficient Data Caching Framework for Spark in Hybrid DRAM/NVM Memory Architectures.

RRAM-Based Single Device for Vector Multiplication and Multibit Storage with Ultrahigh Area Efficiency

Resistive Random Access Memory for Future Information Processing System.

Exploring a SOT-MRAM Based In-Memory Computing for Data Processing.

A hybrid memory built by SSD and DRAM to support in-memory Big Data analytics

RRAM-based Floating-Point In-Memory-Computing Architecture for High Throughput Signal Processing

An NVM SSD-Optimized Query Processing Framework.

Graphsar: A Sparsity-Aware Processing-In-Memory Architecture For Large-Scale Graph Processing On Rerams

ReSQM: Accelerating Database Operations Using ReRAM-Based Content Addressable Memory

An NVM SSD-Based High Performance Query Processing Framework for Search Engines