An Adaptive Erasure-Coded Storage Scheme with an Efficient Code-Switching Algorithm.

Zizhong Wang,Haixia Wang,Airan Shao,Dongsheng Wang

DOI: https://doi.org/10.1145/3404397.3404420

2020-01-01

Abstract:Using erasure codes increases consumption of network traffic and disk I/O tremendously when systems recover data, resulting in high latency of degraded reads. In order to mitigate this problem, we present an adaptive storage scheme based on data access skew, a fact that most data accesses are applied in a small fraction of data. In this scheme, we use both Local Reconstruction Code (LRC), whose recovery cost is low, to store frequently accessed data, and Hitchhiker (HH) code, which guarantees minimum storage cost, to store infrequently accessed data. Besides, an efficient switching algorithm between LRC and HH code with low network and computation costs is provided. The whole system will benefit from low degraded read latency while keeping a low storage overhead, and code-switching will not become a bottleneck.