Abstract:Multi-level buffer cache hierarchies are now commonly seen in most client/server cluster configurations, especially in today's big data application deployment. However, multi-level caching policies deployed so far typically use independent cache replacement algorithms in each level, which has two major drawbacks: (1) File blocks may be redundantly cached on multiple levels, reducing the actual aggregate cache usable size; (2) Less accurate replacement decisions at lower level caches due to weakened locality. Inefficient cache resource usage may result in noticeable performance degradation for big data applications. To address these problems, we propose new adaptive multi-level exclusive caching policies that can dynamically adjust replacement and placement decisions in response to changing access patterns. (1) First, to capture locality information in multi-level cache hierarchies, we propose a Reuse Distance based Adaptive Replacement Caching (ReDARC) algorithm that adopts reuse distance as the means of locality measure and adaptively balances between the Small Reuse Distance (SRD) set and Large Reuse Distance (LRD) set. (2) Second, to achieve exclusive caching and make global caching decisions, we propose an Adaptive Level-Aware Caching Algorithm (ALACA) that works collaboratively with ReDARC. The ALACA algorithm uses an adaptive probabilistic PUSH technique that allows lower caches to push blocks to higher caches and appropriately decide blocks' caching locations with the ReDARC algorithm. In this way, we achieve multi-level exclusive caching with significant cache performance improvement. Our trace-driven simulation experiments show that the policies we proposed achieve a reduction of the client average response time of 8 percent to 56 percent over other multi-level cache schemes. (C) 2017 Elsevier B.V. All rights reserved.

PAM: an Efficient Power-Aware Multilevel Cache Policy to Reduce Energy Consumption of Storage Systems

PAM: An efficient power-aware multi-level cache policy to reduce energy consumption of Software Defined Network

Efficient Cache Resource Aggregation Using Adaptive Multi-Level Exclusive Caching Policies

PLC-cache: Endurable SSD Cache for Deduplication-Based Primary Storage

Adaptive Energy-Aware Design Of A Multi-Bank Flash-Memory Storage System

An Energy-Efficient Last Level Cache Design Using Software and Hardware Collaborative Region-based Management

Energy-Aware Caching Policy Design under Heterogeneous Interests and Sharing Willingness.

Exploiting set-level write non-uniformity for energy-efficient NVM-based hybrid cache

Cache Management with Partitioning-Aware Eviction and Thread-Aware Insertion/Promotion Policy

A Hint Frequency Based Approach to Enhancing the I/O Performance of Multilevel Cache Storage Systems

AMC: an Adaptive Multi‐level Cache Algorithm in Hybrid Storage Systems

Memory Power Optimisation on Low-Bit Multi-Access Cross Memory Address Mapping Schema

MCS-B: an Energy Efficient Storage System for Astronomical Observation Data Based on Logical Block Replacement Strategy

Improving Cache Partitioning Algorithms For Pseudo-Lru Policies

Cost Aware Cache Replacement Policy in Shared Last-Level Cache for Hybrid Memory Based Fog Computing.

Using Memcached to Promote Read Throughput in Massive Small-File Storage System

An On-Demand Mechanism for Data Cache Leakage Power Management

Energy-Oriented Dynamic SPM Allocation Based on Time-Slotted Cache Conflict Graph

Energy-Aware Disk Storage Management: Online Approach with Application in DBMS

Memory Power Optimization on Different Memory Address Mapping Schemas.

MAC: a novel systematically multilevel cache replacement policy for PCM memory