Abstract:RDMA ( Remote Direct Memory Access ) has gained considerable interests in network-attached in-memory key-value stores. However, traversing the remote tree-based index in ordered key-value stores with RDMA becomes a critical obstacle, causing an order-of-magnitude slowdown and limited scalability due to multiple round trips. Using index cache with conventional wisdom—caching partial data and traversing them locally—usually leads to limited effect because of unavoidable capacity misses, massive random accesses, and costly cache invalidations. We argue that the machine learning (ML) model is a perfect cache structure for the tree-based index, termed learned cache . Based on it, we design and implement XStore , an RDMA-based ordered key-value store with a new hybrid architecture that retains a tree-based index at the server to perform dynamic workloads (e.g., inserts) and leverages a learned cache at the client to perform static workloads (e.g., gets and scans). The key idea is to decouple ML model retraining from index updating by maintaining a layer of indirection from logical to actual positions of key-value pairs. It allows a stale learned cache to continue predicting a correct position for a lookup key. XStore ensures correctness using a validation mechanism with a fallback path and further uses speculative execution to minimize the cost of cache misses. Evaluations with YCSB benchmarks and production workloads show that a single XStore server can achieve over 80 million read-only requests per second. This number outperforms state-of-the-art RDMA-based ordered key-value stores (namely, DrTM-Tree, Cell, and eRPC+Masstree) by up to 5.9× (from 3.7×). For workloads with inserts, XStore still provides up to 3.5× (from 2.7×) throughput speedup, achieving 53M reqs/s. The learned cache can also reduce client-side memory usage and further provides an efficient memory-performance tradeoff, e.g., saving 99% memory at the cost of 20% peak throughput.

A hybrid approach based on regression tree and radial-based function network for dynamic storage device performance prediction

Storage Device Performance Prediction with Hybrid Regression Models

An interactive model based on regression tree and K-nearest neighbor for storage device performance prediction

Storage Device Performance Prediction With Selective Bagging Classification And Regression Tree

DRC:A Dynamic-replacement-cost-based Algorithm For SSD/HDD Storage System

Dynamic File Allocation in Storage Area Networks with Neural Network Prediction

Exploit Both SMART Attributes and NAND Flash Wear Characteristics to Effectively Forecast SSD-based Storage Failures in Clusters.

Adaptive Cache Management for Complex Storage Systems Using CNN-LSTM-Based Spatiotemporal Prediction

A Failure Prediction Approach Based on BiLSTM and Deep Feature Extractor for Hard Disk Drives.

Hard drive failure prediction using Decision Trees

Towards Learned Predictability of Storage Systems

Prediction of Critical Filling of a Storage Area Network by Machine Learning Methods

A STATISTICAL REGRESSION-BASED APPROACH FOR PERFORMANCE PREDICTION IN MULTI-TIER APPLICATIONS

XStore : Fast RDMA-Based Ordered Key-Value Store Using Remote Learned Cache

hStorage-DB: Heterogeneity-aware Data Management to Exploit the Full Capability of Hybrid Storage Systems

Performance Modeling of Data Storage Systems using Generative Models

Optimizing B+-tree for Hybrid Storage Systems

Segmentation of Time Series Based on Kinetic Characteristics for Storage Consumption Prediction

Hierarchical Storage for Massive Social Network Data Based on Improved Decision Tree

Collaborative Intelligent Prediction Method for Remaining Useful Life of Hard Disks Based on Heterogeneous Federated Transfer

Workload time series prediction in storage systems: a deep learning based approach