Abstract:Performance prediction of parallel program plays key roles in many areas, such as parallel system design, parallel program optimization, and parallel system procurement. Accurate and efficient performance prediction on large-scale parallel systems is a challenging problem. To solve this problem, we present an effective framework for performance prediction based on the LLVM compiler technique in this paper. We can predict the performance of a parallel program on a small amount of nodes of the target parallel system using this framework toned but not execute this parallel program on a corresponding full-scale parallel system. This framework predicts the performance of computation and communication components separately and combines the two predictions to achieve full program prediction. As for sequential computation, we first combine the static branch probability and loop trip count identification and propose a new instrumentation method to acquire the number of each instruction type. We then construct a test program to measure the average execution time of each instruction type. Finally, we utilize the pruning technique to convert a parallel program into a corresponding sequential program to predict the performance on only one node of the target parallel system. As for communication, we utilize the LogGP model to model point-to-point communication and the artificial neural network technique to model collective communication. We validate our approach by a set of experiments that predict the performance of NAS parallel benchmarks and CGPOP parallel application. Experimental results show that the proposed framework can accurately predict the execution time of parallel programs, and the average error rate of these programs is 10.86%.

Predicting Output Performance of a Petascale Supercomputer

Output Performance Study on a Production Petascale Filesystem.

Hybrid Performance Modeling And Analyzing Of Parallel Systems

Predicting System-level Power for a Hybrid Supercomputer

Prediction of High-Performance Computing Input/Output Variability and Its Application to Optimization for System Configurations

Automated Performance Modeling of HPC Applications Using Machine Learning.

Power Profile Monitoring and Tracking Evolution of System-Wide HPC Workloads

Full Lifecycle Data Analysis on a Large-scale and Leadership Supercomputer: What Can We Learn from It?

Machine Learning Enabled Scalable Performance Prediction of Scientific Codes

Predicting the Performance-Cost Trade-off of Applications Across Multiple Systems

HPC Application Performance Prediction with Machine Learning on New Architectures

Performance and power modeling and prediction using MuMMI and 10 machine learning methods

Modeling and Predicting Power Consumption of High Performance Computing Jobs

Automatic Multi-Parameter Performance Modeling of HPC Applications on a New Sunway Supercomputer

Predictive performance and scalability modeling of a large-scale application

Using Small-Scale History Data to Predict Large-Scale Performance of HPC Application

Exploring Application Performance on Emerging Hybrid-Memory Supercomputers

Analytics of Longitudinal System Monitoring Data for Performance Prediction

PROFPRED: A Compiler-Level IR Based Performance Prediction Framework for MPI Industrial Applications

Predicting HPC Parallel Program Performance Based on LLVM Compiler

I/O Burst Prediction for HPC Clusters using Darshan Logs