Abstract:The most recent generations of graphics processing units (GPUs) boost the execution of convolutional operations required by machine learning applications by resorting to specialized and efficient in-chip accelerators (Tensor Core Units or TCUs) that operate on matrix multiplication tiles. Unfortunately, modern cutting-edge semiconductor technologies are increasingly prone to hardware defects, and the trend to highly stress TCUs during the execution of safety-critical and high-performance computing (HPC) applications increases the likelihood of TCUs producing different kinds of failures. In fact, the intrinsic resiliency to hardware faults of arithmetic units plays a crucial role in safety-critical applications using GPUs (e.g., in automotive, space, and autonomous robotics). Recently, new arithmetic formats have been proposed, particularly those suited to neural network execution. However, the reliability characterization of TCUs supporting different arithmetic formats was still lacking. In this work, we quantitatively assessed the impact of hardware faults in TCU structures while employing two distinct formats (floating-point and posit) and using two different configurations (16 and 32 bits) to represent real numbers. For the experimental evaluation, we resorted to an architectural description of a TCU core (PyOpenTCU) and performed 120 fault simulation campaigns, injecting around 200,000 faults per campaign and requiring around 32 days of computation. Our results demonstrate that the posit format of TCUs is less affected by faults than the floating-point one (by up to three orders of magnitude for 16 bits and up to twenty orders for 32 bits). We also identified the most sensible fault locations (i.e., those that produce the largest errors), thus paving the way to adopting smart hardening solutions.

Structural testing for CUDA programming model

Workload Analysis for Typical GPU Programs Using CUPTI Interface

Analyzing CUDA workloads using a detailed GPU simulator

Exploring Hardware Fault Impacts on Different Real Number Representations of the Structural Resilience of TCUs in GPUs

Precise Identification Of Problems For Structural Test Generation

Understanding the Effects of Permanent Faults in GPU's Parallelism Management and Control Units

An Optimized Model Checking Parallel Algorithm Based on CUDA

Assessing the Impact of Compiler Optimizations on GPUs Reliability

Impact of CUDA and OpenCL on Parallel and Distributed Computing

Performance modeling of graphics processing unit application using static and dynamic analysis

3-D Surface Quality Evaluation Based on Graphics Processing Unit

Efficient fault simulation on many-core processors

Accelerating molecular dynamics simulations using Graphics Processing Units with CUDA

Testing GPU Numerics: Finding Numerical Differences Between NVIDIA and AMD GPUs

Parallel data mining techniques on Graphics Processing Unit with Compute Unified Device Architecture (CUDA)

Adaptive Multidimensional Parallel Fault Simulation Framework on Heterogeneous System

Tools for GPU Computing - Debugging and Performance Analysis of Heterogenous HPC Applications

Evaluating performance portability of five shared-memory programming models using a high-order unstructured CFD solver

CI/CD Efforts for Validation, Verification and Benchmarking OpenMP Implementations

EVALUATION OF SPEEDUP OF MONTE CARLO CALCULATIONS OF TWO SIMPLE REACTOR PHYSICS PROBLEMS CODED FOR THE GPU/CUDA ENVIRONMENT

An Accurate Gpu Performance Model For Effective Control Flow Divergence Optimization