Abstract:Multi-level buffer cache hierarchies are now commonly seen in most client/server cluster configurations, especially in today's big data application deployment. However, multi-level caching policies deployed so far typically use independent cache replacement algorithms in each level, which has two major drawbacks: (1) File blocks may be redundantly cached on multiple levels, reducing the actual aggregate cache usable size; (2) Less accurate replacement decisions at lower level caches due to weakened locality. Inefficient cache resource usage may result in noticeable performance degradation for big data applications. To address these problems, we propose new adaptive multi-level exclusive caching policies that can dynamically adjust replacement and placement decisions in response to changing access patterns. (1) First, to capture locality information in multi-level cache hierarchies, we propose a Reuse Distance based Adaptive Replacement Caching (ReDARC) algorithm that adopts reuse distance as the means of locality measure and adaptively balances between the Small Reuse Distance (SRD) set and Large Reuse Distance (LRD) set. (2) Second, to achieve exclusive caching and make global caching decisions, we propose an Adaptive Level-Aware Caching Algorithm (ALACA) that works collaboratively with ReDARC. The ALACA algorithm uses an adaptive probabilistic PUSH technique that allows lower caches to push blocks to higher caches and appropriately decide blocks' caching locations with the ReDARC algorithm. In this way, we achieve multi-level exclusive caching with significant cache performance improvement. Our trace-driven simulation experiments show that the policies we proposed achieve a reduction of the client average response time of 8 percent to 56 percent over other multi-level cache schemes. (C) 2017 Elsevier B.V. All rights reserved.

ALACC: Accelerating Restore Performance of Data Deduplication Systems Using Adaptive Look-Ahead Window Assisted Chunk Caching.

A Delayed Container Organization Approach to Improve Restore Speed for Deduplication Systems.

Endurable SSD-Based Read Cache for Improving the Performance of Selective Restore from Deduplication Systems

Sliding Look-Back Window Assisted Data Chunk Rewriting For Improving Deduplication Restore Performance

PLC-cache: Endurable SSD Cache for Deduplication-Based Primary Storage

Improving Restore Performance for In-Line Backup System Combining Deduplication and Delta Compression

DEAM：Decoupled, Expressive, Area-Efficient Metadata Cache

ADMAD: Application-Driven Metadata Aware De-duplication Archival Storage System

Efficient Cache Resource Aggregation Using Adaptive Multi-Level Exclusive Caching Policies

R-Admad: High Reliability Provision For Large-Scale De-Duplication Archival Storage Systems

Speed-Dedup: A New Deduplication Framework for Enhanced Performance and Reduced Overhead in Scale-Out Storage

A Novel Optimization Method to Improve De-duplication Storage System Performance

DASH: A duplication-aware flash cache architecture in virtualization environment

A Duplication-Aware SSD-Based Cache Architecture for Primary Storage in Virtualization Environment

Efficient Hybrid Inline and Out-of-line Deduplication for Backup Storage

A fragmentation-aware redundancy elimination scheme for inline backup systems

Applying Delta Compression to Packed Datasets for Efficient Data Reduction

AMC: an Adaptive Multi‐level Cache Algorithm in Hybrid Storage Systems

Accelerating Content-Defined Chunking for Data Deduplication Based on Speculative Jump

Droplet: A Distributed Solution of Data Deduplication

Towards Cluster-wide Deduplication Based on Ceph