Abstract:The widespread adoption of GPUs has driven the development of GPU simulators, which, in turn, lead advancements in both GPU architectures and software optimization. Trace-driven cycle-accurate Cycle-accurate simulators, which provide detailed microarchitectural models and clock-level precision, come at the cost of extended simulation times and require high computational resources. Their scalability has become a bottleneck. A growing trend is the adoption of cycle-approximate simulators, which introduce mathematical modeling of partial hardware units and utilize sampling to accelerate simulation. However, this approach faces challenges regarding the accuracy of performance predictions. To address these limitations, we introduce HyFiSS, a hybrid fidelity stall-aware GPU simulator. HyFiSS features fine-grained stall events tracking and attribution by constructing a detailed execution pipeline model for various stall events on Streaming Multiprocessors (SMs). It accurately emulates the thread block scheduler behavior using real-time scheduling logs and utilizes sampling based on thread block sets to minimize the precision loss due to fine-grained sampling points on the microarchitectural state. We achieve a balance between reliability, speed, and the level of simulation detail, especially regarding bottlenecks. By evaluating a diverse set of benchmarks, HyFiSS achieves a mean absolute percentage error in predicting active cycles that is comparable to the state-of-the-art cycle-accurate simulator Accel-Sim. Moreover, HyFiSS achieves a substantial 12.8 × speedup in the simulation efficiency compared to Accel-Sim. HyFiSS also requires at least 3.2 × less disk storage than both Accel-Sim and another state-of-the-art cycle-approximate simulator PPT-GPU due to its efficient SASS (Streaming Assembler) traces compression. With precise, per-cycle stall events statistics, HyFiSS can provide accurate GPU performance metrics and stall cause reporting. This significantly simplifies performance analysis, bottleneck identification, and performance optimization tasks for researchers, making it easier to enhance GPU performance effectively.

G-SEPM: building an accurate and efficient soft error prediction model for GPGPUs

G-SEPM

GLAM-SERP: Building a Graph Learning-Assisted Model for Soft Error Resilience Prediction in GPGPUs.

G-SEAP: Analyzing and Characterizing Soft-Error Aware Approximation in GPGPUs

Evaluating the Soft Error Resilience of Graph Applications on GPGPUs.

Evaluating the Soft Error Resilience of Instructions for GPU Applications

Comparative analysis of soft-error sensitivity in LU decomposition algorithms on diverse GPUs

TC-SEPM: Characterizing Soft Error Resilience of CNNs on Tensor Cores from Program and Microarchitecture Perspectives

An adaptive GPU performance and power model

Understanding the Effects of Permanent Faults in GPU's Parallelism Management and Control Units

Prediction of GPU Failures Under Deep Learning Workloads

Detecting SDCs in GPGPUs Through an Efficient Instruction Duplication Mechanism

PyGFI: Analyzing and Enhancing Robustness of Graph Neural Networks Against Hardware Errors

Power Modeling Approach for GPU Source Program

HyFiSS: A Hybrid Fidelity Stall-Aware Simulator for GPGPUs

PARIS: Predicting application resilience using machine learning

A Performance Prediction Model for Memory-Intensive GPU Kernels

Detecting SDCs in GPGPUs Through Efficient Partial Thread Redundancy.

Forecasting GPU Performance for Deep Learning Training and Inference

Modeling the Effect of SEUs on the Configuration Memory of SRAM-FPGA Based CNN Accelerators

Exploiting Component Dependency for Accurate and Efficient Soft Error Analysis Via Probabilistic Graphical Models