Abstract:In a distributed storage system, recovering from multiple failures is a critical and frequent task that is crucial for maintaining the system’s reliability and fault-tolerance. In this paper, we focus on the problem of repairing multiple failures in a centralized way, which can be desirable in many data storage configurations; furthermore, we show that a significant repair traffic reduction is possible. First, the fundamental trade-off between the repair bandwidth and the storage size for functional repair is established. Using a graph-theoretic formulation, the optimal tradeoff is identified as the solution to an integer optimization problem, for which a closed-form expression is derived. Expressions of the extreme points, namely the minimum storage multi-node repair (MSMR) and minimum bandwidth multi-node repair (MBMR) points, are obtained. Second, we describe a general framework for converting single erasure minimum storage regenerating codes to MSMR codes. The repair strategy for $e$ failures is similar to that for a single failure; however, certain extra requirements need to be satisfied by the repairing functions for a single failure. For illustration, the framework is applied to product-matrix codes and interference alignment codes. Furthermore, we prove that the functional MBMR point is not achievable for linear exact-repair codes. We also show that the exact-repair minimum bandwidth cooperative repair codes achieve an interior point, that lies near the MBMR point, when $k equiv 1 mod e$ , $k$ being the minimum number of nodes needed to reconstruct the entire data. Finally, for $k> 2e, emid k$ , and $e mid d$ , where $d$ is the number of helper nodes during repair, we show that the functional repair trade-off is not achievable under exact repair, except for maybe a small portion near the MSMR point, which parallels the results for single-erasure repair by Shah et al.

Accelerating erasure coding by exploiting multiple repair paths in distributed storage systems

Towards In-network Acceleration of Erasure Coding

A Comprehensive Repair Scheme for Distributed Storage Systems

Data repair accelerating scheme for erasure-coded storage system based on FPGA and hierarchical parallel decoding structure

Repair Tree: Fast Repair for Single Failure in Erasure-Coded Distributed Storage Systems

NetEC: Accelerating Erasure Coding Reconstruction with In-Network Aggregation

Distributed Data Storage Systems with Opportunistic Repair

Enabling Node Repair in Any Erasure Code for Distributed Storage

Boosting Correlated Failure Repair in SSD Data Centers

Code Constructions for Distributed Storage With Low Repair Bandwidth and Low Repair Complexity

Heterogeneity-Aware Codes with Uncoded Repair for Distributed Storage Systems

Rack-Aware Regenerating Codes with Multiple Erasure Tolerance

Distributed Storage Codes through Hadamard Designs

Bandwidth-Aware Node Repair Optimization for Distributed Storage System Based on Simple Regenerating Code

Replicated Convolutional Codes: A Design Framework for Repair-Efficient Distributed Storage Codes.

Erasure Coding for Distributed Storage: An Overview

A Piggybacking Design Framework for Read-and Download-efficient Distributed Storage Codes

LDPC Code Design for Distributed Storage: Balancing Repair Bandwidth, Reliability and Storage Overhead

XORing Elephants: Novel Erasure Codes for Big Data

Optimized-Cost Repair in Multi-hop Distributed Storage Systems with Network Coding

Centralized Multi-Node Repair Regenerating Codes