Abstract:Automatically predicting performance of parallel applications has been a long-standing goal in the area of high performance computing. However, accurate performance prediction is challenging, since the execution time of parallel applications is determined by several factors, such as sequential computation time, communication time and their complex interactions. Despite previous efforts, accurately estimating the sequential computation time in each process for large-scale parallel applications remains an open problem. In this paper, we propose a novel approach to acquiring accurate sequential computation time using a parallel debugging technique called deterministic replay. The main advantage of our approach is that we only need a single node of a target platform but the whole target platform does not need to be available. Therefore, with this approach we can simply measure the real sequential computation time on a target node for each process on by one. Moreover, we observe that there is great computation similarity in parallel applications, not only within each process but also among different processes. Based on this observation, we further propose representative replay that can significantly reduce replay overhead, because we only need to replay partial iterations for representative processes instead of all of them. Finally, we implement a complete performance prediction system, called PHANTOM, which combines the above computation-time acquisition approach and a trace-driven simulator. We validate our approach on both traditional HPC platforms and the latest Amazon EC2 cloud platform. On both types of platforms, prediction error of our approach is less than 7 percent on average up to 2,500 processes.

Detecting Performance Variance for Parallel Applications Without Source Code

VAPRO: Performance Variance Detection and Diagnosis for Production-Run Parallel Applications

GVARP: Detecting Performance Variance on Large-Scale Heterogeneous Systems

vSensor: leveraging fixed-workload snippets of programs for performance variance detection.

Vs Ensor

Lightweight Noise Detection

Leveraging Code Snippets to Detect Variations in the Performance of HPC Systems

Varcatcher: A Framework for Tackling Performance Variability of Parallel Workloads on Multi-Core

Hybrid Performance Modeling And Analyzing Of Parallel Systems

Progress in development of generally applicable method for monitoring parallel software

Intermittent Performance Analysis Approach of Parallel Programs

Leveraging Graph Analysis to Pinpoint Root Causes of Scalability Issues for Parallel Applications

HPC System Software Enhanced by Source Code Analysis

Design and Implementation of Parallel Program Performance Analysis Method Based on Instrumentation Technology

Research and Design of a Remote Visualization Parallel Program Performance Analysis Tool

Communication Analysis And Performance Prediction Of Parallel Applications On Large-Scale Machines

Identifying Scalability Bottlenecks for Large-Scale Parallel Programs with Graph Analysis

Vapor: Virtual Machine Based Parallel Program Profiling Framework

Performance Prediction for Large-Scale Parallel Applications Using Representative Replay

Offline Data Dependence Analysis to Facilitate Runtime Parallelism Extraction

Architecture Design of Performance Analysis Tool for Parallel Programs