Abstract:In a distributed storage system, recovering from multiple failures is a critical and frequent task that is crucial for maintaining the system’s reliability and fault-tolerance. In this paper, we focus on the problem of repairing multiple failures in a centralized way, which can be desirable in many data storage configurations; furthermore, we show that a significant repair traffic reduction is possible. First, the fundamental trade-off between the repair bandwidth and the storage size for functional repair is established. Using a graph-theoretic formulation, the optimal tradeoff is identified as the solution to an integer optimization problem, for which a closed-form expression is derived. Expressions of the extreme points, namely the minimum storage multi-node repair (MSMR) and minimum bandwidth multi-node repair (MBMR) points, are obtained. Second, we describe a general framework for converting single erasure minimum storage regenerating codes to MSMR codes. The repair strategy for $e$ failures is similar to that for a single failure; however, certain extra requirements need to be satisfied by the repairing functions for a single failure. For illustration, the framework is applied to product-matrix codes and interference alignment codes. Furthermore, we prove that the functional MBMR point is not achievable for linear exact-repair codes. We also show that the exact-repair minimum bandwidth cooperative repair codes achieve an interior point, that lies near the MBMR point, when $k equiv 1 mod e$ , $k$ being the minimum number of nodes needed to reconstruct the entire data. Finally, for $k> 2e, emid k$ , and $e mid d$ , where $d$ is the number of helper nodes during repair, we show that the functional repair trade-off is not achievable under exact repair, except for maybe a small portion near the MSMR point, which parallels the results for single-erasure repair by Shah et al.

A Parallel Partial Merge Repair Algorithm for Multi-block Failures for Erasure Storage Systems

Parallelized In-Network Aggregation for Failure Repair in Erasure-Coded Storage Systems

Multi-level Forwarding and Scheduling Recovery Algorithm in Rapidly-changing Network for Erasure-coded Clusters

A Comprehensive Repair Scheme for Distributed Storage Systems

Boosting Correlated Failure Repair in SSD Data Centers

Repair Tree: Fast Repair for Single Failure in Erasure-Coded Distributed Storage Systems

Multi-node Repair Based on GA_PSO with Fractional Regenerating Code Combined with Prior Replication.

Greedy Transfer Planning Search for Improving Repair Throughput of RDP-like Coded Storage Clusters

Repair Pipelining for Erasure-coded Storage: Algorithms and Evaluation

Centralized Multi-Node Repair Regenerating Codes

Centralized Repair of Multiple Node Failures With Applications to Communication Efficient Secret Sharing

Local Codes with Cooperative Repair in Distributed Storage System

PRM: an Efficient Partial Recovery Method to Accelerate Training Data Reconstruction for Distributed Deep Learning Applications in Cloud Storage Systems

Toward Optimal Repair and Load Balance in Locally Repairable Codes.

A Comprehensive Rearranging Priority Based Method to Accelerate the Reconstruction of RAID Arrays

Accelerating erasure coding by exploiting multiple repair paths in distributed storage systems

A Fast Location-Aware Repair Strategy for Mobile Grouped Storage Clusters

Optimal Repair Algorithm of Single-Disk Failure for Array Codes with Local Properties

Heterogeneity-Aware Codes with Uncoded Repair for Distributed Storage Systems

Distributed Data Storage Systems with Opportunistic Repair

Bandwidth-Aware Node Repair Optimization for Distributed Storage System Based on Simple Regenerating Code