Abstract:Graphics Processing Units (GPUs) are over-stressed to accelerate High-Performance Computing applications and are used to accelerate Deep Neural Networks in several domains where they have a life expectancy of many years. These conditions expose the GPUs hardware to (premature) aging, causing permanent faults to arise after the usual end-of-manufacturing test. Techniques to assess the impact of permanent faults in GPUs are then strongly required, thus allowing to estimate the reliability risk and to possibly mitigate it. In this paper, we present a method to evaluate the effects of permanent faults affecting the GPU scheduler and control units, which are the most peculiar and stressed resources, along with the first figures that allow quantifying these effects. We characterize over 5.83x10^5 permanent fault effects in the scheduler and controllers of a gate-level GPU model. Then, we map the observed error categories in software by instrumenting the code of 13 applications and two convolutional neural networks, injecting more than 1.65x10^5 permanent errors. Our two-level fault injection strategy reduces the evaluation time from hundreds of years of gate-level evaluation to hundreds of hours.We found that faults in the GPU parallelism management units can modify the opcode, the addresses, and the status of thread(s) and warp(s). The large majority (up to 99%) of these hardware permanent errors impacts the running software execution. Errors affecting the instruction operation or resource management hang the code, while 45% of errors in the parallelism management or control-flow induce silent data corruptions.

Parallel Firewalls on General-Purpose Graphics Processing Units

NPGPU: Network processing on graphics processing units

Fastpath-based VPN Gateway over Network Processor

Parallel Transient Stability-Constrained Optimal Power Flow Using GPU as Coprocessor.

An Efficient Acceleration of Symmetric Key Cryptography Using General Purpose Graphics Processing Unit

A Gpu-Based Parallel Fireworks Algorithm For Optimization

High Performance Computing Via a GPU

Overcoming Limitations of GPGPU-Computing in Scientific Applications

Exploiting the Task-Pipelined Parallelism of Stream Programs on Many-Core GPUs.

Exploiting Parallelism in the Simulation of General Purpose Graphics Processing Unit Program

Towards Efficient Alternating Current Optimal Power Flow Analysis on Graphical Processing Units

Efficient Resource Sharing Through GPU Virtualization on Accelerated High Performance Computing Systems

Improving GPU Performance Through Resource Sharing

Exploiting Memory Access Patterns to Improve Memory Performance in Data-Parallel Architectures

A High Performance Parallel Ipsec-Vpn Gateway Design

SPGPU: Spatially Programmed GPU

GFlow: Towards GPU-based High-Performance Table Matching in OpenFlow Switches.

Bank Stealing for a Compact and Efficient Register File Architecture in GPGPU.

High-Performance Flow Classification of Big Data Using Hybrid CPU-GPU Clusters of Cloud Environments

Understanding the Effects of Permanent Faults in GPU's Parallelism Management and Control Units

Gpu-Accelerated Evaluation Platform For High Fidelity Network Modeling