Abstract:We consider the problem of robust dynamic coded distributed storage (RDCDS) that is associated with the coded distributed storage of a message with $N$ servers where 1) it suffices to recover the message from the storage at any $R_r$ servers; and 2) each of the servers stores a coded portion of the message that is at most $\frac{1}{K_c}$ the size of the message. The goal is to enable two main functionalities: the read operation and the update operation of the message. Specifically, at time slot $t$, the user may execute either the read operation or the update operation, where the read operation allows the user to recover the message from the servers, and the update operation allows the user to update the message to the servers in the form of an additive increment so that any up to $X^{(t)}$ colluding servers reveal nothing about the increment. The two functionalities are robust if at any time slot $t$ 1) they tolerate temporarily dropout servers up to certain thresholds (the read threshold is $R_r$ and the update threshold is denoted as $R_u^{(t)}$); and 2) the user may remain oblivious to prior server states. The communication efficiency is measured by the download cost $C_r^{(t)}$ of the read operation and the upload cost $C_u^{(t)}$ of the update operation. Given $K_c$ and $R_r$, we are curious about the optimal $(R_u^{(t)},C_r^{(t)},C_u^{(t)})$ tuple. In this work, we settle the fundamental limits of RDCDS. In particular, denoting the number of dropout servers at time slot $t$ as $|\mathcal{D}^{(t)}|$, we first show that 1) $R_u^{(t)}\geq N-R_r+\lceil K_c\rceil+X^{(t)}$; and 2) $C_r^{(t)}\geq \frac{N-|\mathcal{D}^{(t)}|}{N-R_r+\lceil K_c\rceil-|\mathcal{D}^{(t)}|}, C_u^{(t)}\geq \frac{N-|\mathcal{D}^{(t)}|}{R_r-X^{(t)}-|\mathcal{D}^{(t)}|}$. Then, inspired by the idea of staircase codes, we construct an RDCDS scheme that simultaneously achieves the above lower bounds.

Tight Lower Bound on Cross-Rack Update Bandwidth and Explicit Constructions

Cross-Rack Update Bandwidth for Distributed Storage Systems

Rack-Aware Regenerating Codes with Multiple Erasure Tolerance

Rack-Aware Regenerating Codes with Fewer Helper Racks

Explicit Construction of Minimum Bandwidth Rack-Aware Regenerating Codes

Rack-aware minimum-storage regenerating codes with optimal access

Construction of Locally Repairable Array Codes with Optimal Repair Bandwidth under the Rack-Aware Storage Model

Explicit constructions of MSR codes for clustered distributed storage: The rack-aware storage model

How to Read and Update Coded Distributed Storage Robustly and Optimally?

Fundamental Limits on Communication for Oblivious Updates in Storage Networks

Demand-Aware Erasure Coding for Distributed Storage Systems

Product-Matrix Construction of Minimum Storage Rack-aware Regenerating Codes.

Achievable Lower Bound on the Optimal Access Bandwidth of (K + 2, K, 2)-MDS Array Code with Degraded Read Friendly

Code Constructions for Distributed Storage With Low Repair Bandwidth and Low Repair Complexity

Advanced Elastic Reed-Solomon Codes for Erasure-Coded Key Value Stores

Efficient Scheduling for Multi-Block Updates in Erasure Coding Based Storage Systems.

An Adaptive Erasure-Coded Storage Scheme with an Efficient Code-Switching Algorithm.

Network Coding for Distributed Storage Systems

Explicit Constructions of MBR and MSR Codes for Clustered Distributed Storage

Erasure Codes for Distributed Storage: Tight Bounds and Matching Constructions

On the Repair Bandwidth and Repair Access of Two Storage Systems: Large-Scale and Uniform Rack-Aware Storage Systems