Abstract:Storage clouds, such as Amazon S3, are being widely used for web services and Internet applications. It has been observed that the delay for retrieving data from and placing data into the clouds is quite random, and exhibits weak correlations between different read/write requests. This inspires us to investigate a key problem: can we reduce the delay by transmitting data replications in parallel or using powerful erasure codes? In this paper, we study the problem of reducing the delay of downloading data from cloud storage systems by leveraging multiple parallel threads, assuming that the data has been encoded and stored in the clouds using fixed rate forward error correction (FEC) codes with parameters (n, k). That is., each file is divided into k equal-sized chunks, which are then expanded into n chunks such that any k chunks out of the n are sufficient to successfully restore the original file. The model can be depicted as a multiple-server queue with arrivals of data retrieving requests and a server corresponding to a thread. However, this is not a typical queueing model because a server can terminate its operation, depending on when other servers complete their service (due to the redundancy that is spread across the threads). Hence, to the best of our knowledge, the analysis of this queueing model remains quite uncharted. Real traces from Amazon S3 show that the time to retrieve a fixed size chunk is random and can be accurately approximated as an i.i.d. exponentially distributed random variable. We show that any work-conserving scheme is delay-optimal when k = 1. When k > 1, we find that a simple greedy scheme, which allocates all available threads to the head of line request, is delay optimal, which appears surprising.

Caching with Statistical Request Delay Information.

Caching with Time Domain Buffer Sharing

Delay-Optimal Edge Caching with Imperfect Content Fetching Via Stochastic Learning

Caching With Finite Buffer and Request Delay Information: A Markov Decision Process Approach

L-QoCo: learning to optimize cache capacity overloading in storage systems

Delay-Optimal Edge Cache Replacement with Non-Markovian Content Fetching

Cache Placement in Two-Tier HetNets with Limited Storage Capacity: Cache or Buffer?

Joint pushing and caching communication with 2-dimensional queue model: Delay-cost tradeoff (Invited Paper).

Maximizing Hit Ratio in Finite-Buffer Caching with Request Delay Information: an MDP Approach

Storage-Efficient Edge Caching With Asynchronous User Requests

Distributed Packet Forwarding and Caching Based on Stochastic Network Utility Maximization

Coded Joint Pushing and Caching with Asynchronous User Requests

A Unified Framework for Caching in Arbitrary Networks

When Queueing Meets Coding: Optimal-latency Data Retrieving Scheme in Storage Clouds

Sampling-based Caching for Low Latency in Distributed Coded Storage Systems

Cost-Driven Data Caching in Edge-based Content Delivery Networks

Joint Pushing and Caching with a Finite Receiver Buffer: Optimal Policies and Throughput Analysis

Storage Efficient Edge Caching with Time Domain Buffer Sharing at Base Stations

On the Delay-Storage Trade-off in Content Download from Coded Distributed Storage Systems

Fractional Dynamic Caching: A Collaborative Design of Storage and Backhaul