Abstract:Multi-level buffer cache hierarchies are now commonly seen in most client/server cluster configurations, especially in today's big data application deployment. However, multi-level caching policies deployed so far typically use independent cache replacement algorithms in each level, which has two major drawbacks: (1) File blocks may be redundantly cached on multiple levels, reducing the actual aggregate cache usable size; (2) Less accurate replacement decisions at lower level caches due to weakened locality. Inefficient cache resource usage may result in noticeable performance degradation for big data applications. To address these problems, we propose new adaptive multi-level exclusive caching policies that can dynamically adjust replacement and placement decisions in response to changing access patterns. (1) First, to capture locality information in multi-level cache hierarchies, we propose a Reuse Distance based Adaptive Replacement Caching (ReDARC) algorithm that adopts reuse distance as the means of locality measure and adaptively balances between the Small Reuse Distance (SRD) set and Large Reuse Distance (LRD) set. (2) Second, to achieve exclusive caching and make global caching decisions, we propose an Adaptive Level-Aware Caching Algorithm (ALACA) that works collaboratively with ReDARC. The ALACA algorithm uses an adaptive probabilistic PUSH technique that allows lower caches to push blocks to higher caches and appropriately decide blocks' caching locations with the ReDARC algorithm. In this way, we achieve multi-level exclusive caching with significant cache performance improvement. Our trace-driven simulation experiments show that the policies we proposed achieve a reduction of the client average response time of 8 percent to 56 percent over other multi-level cache schemes. (C) 2017 Elsevier B.V. All rights reserved.

An Improved Multi-core Shared Cache Replacement Algorithm

A Frequency Based Cache Replacement Algorithm with Partition of CMPs

Cache Replacement Policies for Improving LLC Performance in Multi-Core Processors

Efficient shared cache management through sharing-aware replacement and streaming-aware insertion policy

An Adaptive Cache Management Using Dual LRU Stacks to Improve Buffer Cache Performance

CCF-LRU: a new buffer replacement algorithm for flash memory

Improving Cache Hits On Replacment Blocks Using Weighted LRU-LFU Combinations

Two Cooperative Partitions for the Lase Level Cache

Improving Cache Partitioning Algorithms For Pseudo-Lru Policies

LCR: Load-Aware Cache Replacement Algorithm for Flash-Based SSDs

Efficient Cache Resource Aggregation Using Adaptive Multi-Level Exclusive Caching Policies

Predictable Sharing of Last-level Cache Partitions for Multi-core Safety-critical Systems

Filtering cache pollution by using replacement operation based on confidence estimation

SLRF: A High-efficiency Shared Less Reused Filter in Chip Multiprocessors

Cost Aware Cache Replacement Policy in Shared Last-Level Cache for Hybrid Memory Based Fog Computing.

Block Level Locality Aware LRU Cache Management Strategy for Flash Memory Storage

Understanding the Memory Behavior of Emerging Multi-core Workloads

Cache Replacement Algorithm Based on Network Attached Optical Jukebox

Enhancing LRU Replacement Via Phantom Associativity

Retention Benefit Based Intelligent Cache Replacement

Learning Cache Replacement with CACHEUS