Abstract:This paper considers capacity-achieving coding for the clustered form of distributed storage that reflects practical storage networks. To reflect the clustered structure with limited cross-cluster communication bandwidths, nodes in the same cluster are set to communicate $\beta_I$ symbols, while nodes in other clusters can communicate $\beta_c \leq \beta_I$ symbols with one another. We provide two types of exact regenerating codes which achieve the capacity of clustered distributed storage: the minimum-bandwidth-regenerating (MBR) codes and the minimum-storage-regenerating (MSR) codes. First, we construct MBR codes for general parameter settings of clustered distributed storage. The suggested MBR code is a generalization of an existing code proposed by Rashmi et al., for scenarios where storage nodes are dispersed into L > 1 clusters. The proposed MBR code for the $\beta_c = 0$ case requires a much smaller field size compared to existing local MBR codes. Secondly, we devise MSR codes for clustered distributed storage. Focus is given on two important cases:$\epsilon=0$ and $\epsilon \in [1/(n-k), 1]$, where $\epsilon=\beta_c/\beta_I$ is the ratio of the available cross- to intra-cluster repair bandwidths, n is the total number of distributed nodes and k is the number of contact nodes in data retrieval. The former represents the scenario where cross-cluster communication is not allowed, while the latter corresponds to the case of minimum node storage overhead. For $\epsilon=0$, two existing locally repairable codes are proven to be MSR codes for the clustered model. For $\epsilon \in [1/(n-k), 1]$, existing MSR codes for the non-clustered model are applicable to clustered scenarios with a simple modification.

Explicit Minimum Storage Regenerating Codes

Minimum Storage Regenerating Codes for Scalable Distributed Storage

Searching for Minimum Storage Regenerating Codes

Replication based storage systems with local repair

Survey for regenerating codes for distributed storage

Concurrent Regenerating Codes

Network Coding for Distributed Storage Systems

Product Matrix Minimum Storage Regenerating Codes with Flexible Number of Helpers

Analysis and Construction of Functional Regenerating Codes with Uncoded Repair for Distributed Storage Systems

Design of Exact Regenerating Hierarchical Code for Distributed Storage System

Cascade Codes For Distributed Storage Systems

Simple Regenerating Codes: Network Coding for Cloud Storage

Rack-Aware Regenerating Codes with Multiple Erasure Tolerance

Rack-Aware Regenerating Codes with Fewer Helper Racks

Explicit Constructions of MBR and MSR Codes for Clustered Distributed Storage

Erasure Coding for Distributed Storage: An Overview

Generalization of Minimum Storage Regenerating Codes for Heterogeneous Distributed Storage Systems

BASIC Codes: Low-Complexity Regenerating Codes for Distributed Storage Systems.

Replication-Based Distributed Storage Systems with Variable Repetition Degrees

Replicated Convolutional Codes: A Design Framework for Repair-Efficient Distributed Storage Codes.

Explicit MBR All-Symbol Locality Codes