Abstract:Soft errors in scientific computing applications are becoming inevitable with the ever-increasing system scale and execution time, and new technologies that feature increased transistor density and lower voltage. Soft errors can be mainly classified into two categories: bit-flipping error e.g. 1 becomes −1 in random access memory; and computation error e.g. 1+1 = 3 in floating point units. Traditionally, bit-flipping error is handled by the Error Correcting Code ECC technique, and computation error is dealt with the Triple Modular Redundancy TMR method. Note that, ECC cannot handle computation error, while TMR cannot deal with bit-flipping error and is not efficient on handling computation error. To uniformly and efficiently handle both computation and bit-flipping errors in matrix operations, the Algorithm-Based Fault Tolerance ABFT method is developed. This paper focuses on the detection of soft errors in the LU Decomposition with Partial Pivoting LUPP algorithm, which is widely used in scientific computing applications. First, this paper notes that existing ABFT methods are not adequate to detect soft errors in LUPP in terms of time or space. Then we propose a new ABFT algorithm which can detect soft errors in LUPP both flexible in time and comprehensive in space. Flexible in time means that soft errors can be detected flexibly during the execution instead of only at the end of LUPP, while comprehensive in space indicates that all of the elements in data matrices L and U will be covered for detecting soft errors. To show the feasibility and efficiency of the proposed algorithm, this paper has incorporated it into the implementation of LUPP in the widely used benchmark High Performance Linpack HPL. Experiment results verify the feasibility of this algorithm: for soft errors injected at various timings and to different elements in LUPP, this algorithm has detected most of the injected errors, which have covered all of the errors that cannot pass the residual check of HPL. Both theoretical overhead analysis and experiments demonstrate that this ABFT algorithm is also very efficient at detecting soft errors in LUPP.

Fault Tolerant Parallel FFTs Using Error Correction Codes and Parseval Checks

Fault Tolerant Parallel Filters Based on Error Correction Codes.

Efficient Coding Schemes for Fault-Tolerant Parallel Filters

A Novel Low-Overhead Fault Tolerant Parallel-Pipelined FFT Design

Correcting Soft Errors Online in Fast Fourier Transform

Approximate Floating-Point FFT Design with Wide Precision-Range and High Energy Efficiency.

FT-PBLAS: PBLAS-Based Fault-Tolerant Linear Algebra Computation on High-performance Computing Systems

TurboFFT: A High-Performance Fast Fourier Transform with Fault Tolerance on GPU

TurboFFT: Co-Designed High-Performance and Fault-Tolerant Fast Fourier Transform on GPUs

Algorithmic Based Fault Tolerance Applied to High Performance Computing

Soft error detection and correction for parallel digital filters using Hamming code

Specialising for High Performance FFT Algorithms Based on Fixed-Point DSP

Block-Checksum-Based Fault Tolerance for Matrix Multiplication on Large-Scale Parallel Systems.

Detection of soft errors in LU decomposition with partial pivoting using algorithm-based fault tolerance

Designing fault-tolerant circuits using detector error models

Area-efficient Error-Resilient Discrete Fourier Transformation Design Using Stochastic Computing

Study on Error-Detecting Approach for Fault Tolerance Recomputing Oriented Parallel Digital Terrain Analysis

Data Flow Error Recovery with Checkpointing and Instruction-Level Fault Tolerance

Building Single Fault Survivable Parallel Algorithms for Matrix Operations Using Redundant Parallel Computation

Parallel Optimization and Hardware Customization for Fast Fourier Transform

Parallel Sparse FFT.