Abstract:As deep learning has produced dramatic breakthroughs in many areas, it has motivated emerging studies on the combination between neural networks and cache replacement algorithms. However, deep learning is a poor fit for performing cache replacement in hardware implementation because its neural network models are impractically large and slow. Many studies have tried to use the guidance of the Belady algorithm to speed up the prediction of cache replacement. But it is still impractical to accurately predict the characteristics of future access addresses, introducing inaccuracy in the discrimination of complex access patterns. Therefore, this paper presents the LSTM-CRP algorithm as well as its efficient hardware implementation, which employs the long short-term memory (LSTM) for access pattern identification at run-time to guide cache replacement algorithm. LSTM-CRP first converts the address into a novel key according to the frequency of the access address and a virtual capacity of the cache, which has the advantages of low information redundancy and high timeliness. Using the key as the inputs of four offline-trained LSTM network-based predictors, LSTM-CRP can accurately classify different access patterns and identify current cache characteristics in a timely manner via an online set dueling mechanism on sampling caches. For efficient implementation, heterogeneous lightweight LSTM networks are dedicatedly constructed in LSTM-CRP to lower hardware overhead and inference delay. The experimental results show that LSTM-CRP was able to averagely improve the cache hit rate by 20.10%, 15.35%, 12.11% and 8.49% compared with LRU, RRIP, Hawkeye and Glider, respectively. Implemented on Xilinx XCVU9P FPGA at the cost of 15,973 LUTs and 1610 FF registers, LSTM-CRP was running at a 200 MHz frequency with 2.74 W power consumption.

P4LRU: Towards an LRU Cache Entirely in Programmable Data Plane.

Sra: Switch Resource Aggregation For Application Offloading In Programmable Networks

LPCA: Learned MRC Profiling based Cache Allocation for File Storage Systems

B-Cache: A Behavior-Level Caching Framework for the Programmable Data Plane

Improving Cache Partitioning Algorithms For Pseudo-Lru Policies

FarReach: Write-back Caching in Programmable Switches.

Poche: A Priority-Based Flow-Aware In-Network Caching Scheme in Data Center Networks

Prr: A Low-Overhead Cache Replacement Algorithm for Embedded Processors

Scalable Hardware Content Router: Architecture, Modeling and Performance

Hybrid-LRU Caching Scheme for PDRAM Hybrid Memory Architecture in Cloud Computing

Efficient Flow Table Caching Architecture and Replacement Policy for SDN Switches

A Split Architecture Approach to Terabyte-Scale Caching in a Protocol-Oblivious Forwarding Switch

SFCache: Hybrid NF Synthesization in Runtime with Rule-Caching in Programmable Switches

A Low-Latency Software-Based Route Lookup Implementation for Network Processors.

An Adaptive Cache Management Using Dual LRU Stacks to Improve Buffer Cache Performance

A comprehensive latency profiling study of the Tofino P4 programmable ASIC-based hardware

LSTM-CRP: Algorithm-Hardware Co-Design and Implementation of Cache Replacement Policy Using Long Short-Term Memory

Hybrid Cache Architecture for High Speed Packet Processing

PAM: An efficient power-aware multi-level cache policy to reduce energy consumption of Software Defined Network

Two Cooperative Partitions for the Lase Level Cache

A Novel Cache Replacement Policy Via Dynamic Adaptive Insertion And Re-Reference Prediction