Abstract:Soft errors in scientific computing applications are becoming inevitable with the ever-increasing system scale and execution time, and new technologies that feature increased transistor density and lower voltage. Soft errors can be mainly classified into two categories: bit-flipping error e.g. 1 becomes −1 in random access memory; and computation error e.g. 1+1 = 3 in floating point units. Traditionally, bit-flipping error is handled by the Error Correcting Code ECC technique, and computation error is dealt with the Triple Modular Redundancy TMR method. Note that, ECC cannot handle computation error, while TMR cannot deal with bit-flipping error and is not efficient on handling computation error. To uniformly and efficiently handle both computation and bit-flipping errors in matrix operations, the Algorithm-Based Fault Tolerance ABFT method is developed. This paper focuses on the detection of soft errors in the LU Decomposition with Partial Pivoting LUPP algorithm, which is widely used in scientific computing applications. First, this paper notes that existing ABFT methods are not adequate to detect soft errors in LUPP in terms of time or space. Then we propose a new ABFT algorithm which can detect soft errors in LUPP both flexible in time and comprehensive in space. Flexible in time means that soft errors can be detected flexibly during the execution instead of only at the end of LUPP, while comprehensive in space indicates that all of the elements in data matrices L and U will be covered for detecting soft errors. To show the feasibility and efficiency of the proposed algorithm, this paper has incorporated it into the implementation of LUPP in the widely used benchmark High Performance Linpack HPL. Experiment results verify the feasibility of this algorithm: for soft errors injected at various timings and to different elements in LUPP, this algorithm has detected most of the injected errors, which have covered all of the errors that cannot pass the residual check of HPL. Both theoretical overhead analysis and experiments demonstrate that this ABFT algorithm is also very efficient at detecting soft errors in LUPP.

Fault Tolerant One-Sided Matrix Decompositions on Heterogeneous Systems with GPUs.

Block-Checksum-Based Fault Tolerance for Matrix Multiplication on Large-Scale Parallel Systems.

Building Single Fault Survivable Parallel Algorithms for Matrix Operations Using Redundant Parallel Computation

Algorithmic Based Fault Tolerance Applied to High Performance Computing

Anatomy of High-Performance GEMM with Online Fault Tolerance on GPUs

FT-PBLAS: PBLAS-Based Fault-Tolerant Linear Algebra Computation on High-performance Computing Systems

Adaptive Multidimensional Parallel Fault Simulation Framework on Heterogeneous System

Fault Tolerance for RRAM-Based Matrix Operations

Efficient Matrix Factorization on Heterogeneous CPU-GPU Systems

Tridiagonalization of a dense symmetric matrix on multiple GPUs and its application to symmetric eigenvalue problems

FT-GEMM: A Fault Tolerant High Performance GEMM Implementation on x86 CPUs

Algorithmic Fault Detection for RRAM-based Matrix Operations

A Novel Fully Hardware-Implemented SVD Solver Based on Ultra-Parallel BCV Jacobi Algorithm

Building algorithmically nonstop fault tolerant MPI programs

A New and Efficient Algorithm-Based Fault Tolerance Scheme for A Million Way Parallelism

Fault Tolerance for Conjugate Gradient Solver Based on Ft-Mpi

FT-Offload: A Scalable Fault-Tolerance Programing Model on MIC Cluster

Detection of soft errors in LU decomposition with partial pivoting using algorithm-based fault tolerance

Algorithm-Directed Crash Consistence in Non-Volatile Memory for HPC.

TurboFFT: A High-Performance Fast Fourier Transform with Fault Tolerance on GPU

Parallel singular value decomposition on heterogeneous multi-core and multi-GPU platforms