Abstract:We consider the problem of robust dynamic coded distributed storage (RDCDS) that is associated with the coded distributed storage of a message with $N$ servers where 1) it suffices to recover the message from the storage at any $R_r$ servers; and 2) each of the servers stores a coded portion of the message that is at most $\frac{1}{K_c}$ the size of the message. The goal is to enable two main functionalities: the read operation and the update operation of the message. Specifically, at time slot $t$, the user may execute either the read operation or the update operation, where the read operation allows the user to recover the message from the servers, and the update operation allows the user to update the message to the servers in the form of an additive increment so that any up to $X^{(t)}$ colluding servers reveal nothing about the increment. The two functionalities are robust if at any time slot $t$ 1) they tolerate temporarily dropout servers up to certain thresholds (the read threshold is $R_r$ and the update threshold is denoted as $R_u^{(t)}$); and 2) the user may remain oblivious to prior server states. The communication efficiency is measured by the download cost $C_r^{(t)}$ of the read operation and the upload cost $C_u^{(t)}$ of the update operation. Given $K_c$ and $R_r$, we are curious about the optimal $(R_u^{(t)},C_r^{(t)},C_u^{(t)})$ tuple. In this work, we settle the fundamental limits of RDCDS. In particular, denoting the number of dropout servers at time slot $t$ as $|\mathcal{D}^{(t)}|$, we first show that 1) $R_u^{(t)}\geq N-R_r+\lceil K_c\rceil+X^{(t)}$; and 2) $C_r^{(t)}\geq \frac{N-|\mathcal{D}^{(t)}|}{N-R_r+\lceil K_c\rceil-|\mathcal{D}^{(t)}|}, C_u^{(t)}\geq \frac{N-|\mathcal{D}^{(t)}|}{R_r-X^{(t)}-|\mathcal{D}^{(t)}|}$. Then, inspired by the idea of staircase codes, we construct an RDCDS scheme that simultaneously achieves the above lower bounds.

Cross-Rack Update Bandwidth for Distributed Storage Systems

Tight Lower Bound on Cross-Rack Update Bandwidth and Explicit Constructions

Rack-Aware Regenerating Codes with Multiple Erasure Tolerance

Multi-Rack Regenerating Codes for Hierarchical Distributed Storage Systems

GRPU: an Efficient Graph-based Cross-Rack Parallel Update Scheme for Cloud Storage Systems

Rack-Aware Regenerating Codes with Fewer Helper Racks

XHR- Code: An Efficient Wide Stripe Erasure Code to Reduce Cross- Rack Overhead in Cloud Storage Systems

Explicit Construction of Minimum Bandwidth Rack-Aware Regenerating Codes

Demand-Aware Erasure Coding for Distributed Storage Systems

Efficient Scheduling for Multi-Block Updates in Erasure Coding Based Storage Systems.

Performance analysis on distributed storage systems in ring networks.

Product-Matrix Construction of Minimum Storage Rack-aware Regenerating Codes.

On the Repair Bandwidth and Repair Access of Two Storage Systems: Large-Scale and Uniform Rack-Aware Storage Systems

Construction of Locally Repairable Array Codes with Optimal Repair Bandwidth under the Rack-Aware Storage Model

How to Read and Update Coded Distributed Storage Robustly and Optimally?

Rack-aware minimum-storage regenerating codes with optimal access

Fundamental Limits on Communication for Oblivious Updates in Storage Networks

Achievable Lower Bound on the Optimal Access Bandwidth of (K + 2, K, 2)-MDS Array Code with Degraded Read Friendly

A Comprehensive Repair Scheme for Distributed Storage Systems

D3: Deterministic Data Distribution for Efficient Data Reconstruction in Erasure-Coded Distributed Storage Systems

STORE: Data recovery with approximate minimum network bandwidth and disk I/O in distributed storage systems