Abstract:Erasure coding has been widely used in commodity datacenter to tolerate faults, due to its ability to simultaneously provide high storage space utilization and data reliability. However, when data loss occurs, the extra data decoding and traffic overhead makes it difficult to improve their data repair efficiency, limiting their further application in the hot data storage systems. In this paper, we proposed an FPGA-based Data Repair accelerating scheme (FPGA-ECDR) for erasure-coded storage system, which employs the Cauchy Reed-Solomon(CRS) code, to overcome the aforementioned limitation. In FPGA-ECDR, multiple modules are designed to work collaboratively, enhancing the efficiency of data flow and ensuring the reliability of the data repair process. Then, a CRS decoding algorithm based on check matrix is used to reduce the complexity of matrix inversion in the decoding process, and hardware acceleration of the algorithm is realized by FPGA. Moreover, we proposed a Hierarchical Parallel Decoding Structure (HPDS) to optimize cache data reading timing and XOR logic operations in the decoding process. HPDS can effectively reduce the impact of Column Address Strobe (CAS) latency and improve repair efficiency. Finally, we conducted FPGA board-level verification of the proposed scheme, testing on CRS codes with different data sizes and parameters. The experimental results show that compared with the schemes of the current mainstream open-source erasure coding library Jerasure and Intel ISA-L acceleration library, as well as the Xilinx RS code decoding acceleration scheme based on the same FPGA platform, our proposed scheme has lower decoding latency and can improve the data decoding rate by 3.2 to 148.5 times and enhances the repair throughput by up to 21.4 times in fault-tolerant storage system.

Study on CRC parallel algorithm and its implementation in FPGA

A Formal Design of Parallel CRC Circuit

An Efficient Parallel CRC Computing Method for High Bandwidth Networks and FPGA Implementation

VLSI Decoding Design of Low-Density Parity-Check Codes Based on Circulant Matrices

Study and realization of EPA communication schedule algorithm based on parallel processing

An Efficient Method for Parallel CRC Automatic Generation

Design of a Reconfigurable Cryptographic Engine

Matrix-similarity-transformation-based pipeline architecture for parallel CRC implementation

The Research of FPGA Reliability Based on Redundancy Methods

CRC Look-up Table Optimization for Single-Bit Error Correction

Fast CRCs (Extended Version)

Efficient Coding Schemes for Fault-Tolerant Parallel Filters

Cross-layer iterative decoding of irregular LDPC codes using cyclic redundancy check codes

Improved CRC Calculation Strategies for 64-Bit Serial RapidIO

Selective Parallel Crc Computation Schemes for Rapidio

Data repair accelerating scheme for erasure-coded storage system based on FPGA and hierarchical parallel decoding structure

The Design and Implementation of Parallel EEPROM Programmer

Design and Implementation of Reed-Solomon Codes on Fpga for the Multi-Wavelength Optical Storage System

CRC Circuit Design for SRAM-Based FPGA Configuration Bit Correction

The Principle of Reed-Solomon Encoding-Decoding and Its FPGA Implement

The Implementation of Crc-16 Based on A Novel Fpga: A Collection of Reconfiguration Operations(Reops)