Abstract:Solid-State Drives (SSDs) have significant performance advantages over traditional Hard Disk Drives (HDDs) such as lower latency and higher throughput. Significantly higher price per capacity and limited lifetime, however, prevents designers to completely substitute HDDs by SSDs in enterprise storage systems. SSD-based caching has recently been suggested for storage systems to benefit from higher performance of SSDs while minimizing the overall cost. While conventional caching algorithms such as Least Recently Used (LRU) provide high hit ratio in processors, due to the highly random behavior of Input/Output (I/O) workloads, they hardly provide the required performance level for storage systems. In addition to poor performance, inefficient algorithms also shorten SSD lifetime with unnecessary cache replacements. Such shortcomings motivate us to benefit from more complex non-linear algorithms to achieve higher cache performance and extend SSD lifetime. In this paper, we propose RC-RNN, the first reconfigurable SSD-based cache architecture for storage systems that utilizes machine learning to identify performance-critical data pages for I/O caching. The proposed architecture uses Recurrent Neural Networks (RNN) to characterize ongoing workloads and optimize itself towards higher cache performance while improving SSD lifetime. RC-RNN attempts to learn characteristics of the running workload to predict its behavior and then uses the collected information to identify performance-critical data pages to fetch into the cache. Experimental results show that RC-RNN characterizes workloads with an accuracy up to 94.6% for SNIA I/O workloads. RC-RNN can perform similarly to the optimal cache algorithm by an accuracy of 95% on average, and outperforms previous SSD caching architectures by providing up to 7x higher hit ratio and decreasing cache replacements by up to 2x.

RecSSD: near data processing for solid state drive based recommendation inference

RecNMP: Accelerating Personalized Recommendation with Near-Memory Processing

NDRec: A Near-Data Processing System for Training Large-Scale Recommendation Models

Cognitive Ssd: A Deep Learning Engine For In-Storage Data Retrieval

Rerec: In-ReRAM Acceleration with Access-Aware Mapping for Personalized Recommendation

RC-RNN: Reconfigurable Cache Architecture for Storage Systems Using Recurrent Neural Networks

DeepRecSys: A System for Optimizing End-To-End At-scale Neural Recommendation Inference

Supporting Massive DLRM Inference Through Software Defined Memory

Near-Memory Processing in Action: Accelerating Personalized Recommendation with AxDIMM.

MicroRec: Efficient Recommendation Inference by Hardware and Data Structure Solutions

SSD4Rec: A Structured State Space Duality Model for Efficient Sequential Recommendation

iMARS: An In-Memory-Computing Architecture for Recommendation Systems

PreSto: An In-Storage Data Preprocessing System for Training Recommendation Models

Improving the accuracy, adaptability, and interpretability of SSD failure prediction models

Near-Data Processing for Differentiable Machine Learning Models

A Flexible Embedding-Aware Near Memory Processing Architecture for Recommendation System

DisaggRec: Architecting Disaggregated Systems for Large-Scale Personalized Recommendation

Pushing the Performance Envelope of DNN-based Recommendation Systems Inference on GPUs

NDSEARCH: Accelerating Graph-Traversal-Based Approximate Nearest Neighbor Search through Near Data Processing

Optimizing Inference Quality with SmartNIC for Recommendation System

A Hybrid RRAM-SRAM Computing-In-Memory Architecture for Deep Neural Network Inference-Training Edge Acceleration