Abstract:Automatically predicting performance of parallel applications has been a long-standing goal in the area of high performance computing. However, accurate performance prediction is challenging, since the execution time of parallel applications is determined by several factors, such as sequential computation time, communication time and their complex interactions. Despite previous efforts, accurately estimating the sequential computation time in each process for large-scale parallel applications remains an open problem. In this paper, we propose a novel approach to acquiring accurate sequential computation time using a parallel debugging technique called deterministic replay. The main advantage of our approach is that we only need a single node of a target platform but the whole target platform does not need to be available. Therefore, with this approach we can simply measure the real sequential computation time on a target node for each process on by one. Moreover, we observe that there is great computation similarity in parallel applications, not only within each process but also among different processes. Based on this observation, we further propose representative replay that can significantly reduce replay overhead, because we only need to replay partial iterations for representative processes instead of all of them. Finally, we implement a complete performance prediction system, called PHANTOM, which combines the above computation-time acquisition approach and a trace-driven simulator. We validate our approach on both traditional HPC platforms and the latest Amazon EC2 cloud platform. On both types of platforms, prediction error of our approach is less than 7 percent on average up to 2,500 processes.

Stage: Query Execution Time Prediction in Amazon Redshift

Reduct Algorithm Based Execution Times Prediction In Knowledge Discovery Cloud Computing Environment

Improving MapReduce Performance with Partial Speculative Execution

Why TPC is Not Enough: An Analysis of the Amazon Redshift Fleet

Performance Prediction for Performance-Sensitive Queries Based on Algorithmic Complexity

Learning-based SPARQL Query Performance Modeling and Prediction

Performance Prediction for Large-Scale Parallel Applications Using Representative Replay

Query Performance Prediction Based on Physical Operation-level Models

DeepQT : Learning Sequential Context for Query Execution Time Prediction

MERLIN: Multi-stagE query performance prediction for dynamic paRallel oLap pIpeliNe

Plan-Structured Deep Neural Network Models for Query Performance Prediction

Reliable Estimation of Execution Time of MapReduce Program

A performance prediction scheme for computation-intensive applications on cloud

Database Query Cost Prediction Using Recurrent Neural Network

End-to-end Optimization of Machine Learning Prediction Queries

Estimation Accuracy On Execution Time Of Run-Time Tasks In A Heterogeneous Distributed Environment

Recurrent neural network-based database query time prediction method

Time-Series Analysis for Price Prediction of Opportunistic Cloud Computing Resources

Forecasting SQL Query Cost at Twitter

Saving Money for Analytical Workloads in the Cloud