Abstract:Predicting the performance of an application running on parallel computing platforms is increasingly becoming important because of its influence on development time and resource management. However, predicting the performance with respect to parallel processes is complex for iterative and multi-stage applications. This research proposes a performance approximation approach FiM to predict the calculation time with FiM-Cal and communication time with FiM-Com of an application running on a distributed framework. FiM-Cal consists of two key components that are coupled with each other: (1) a Stochastic Markov Model to capture non-deterministic runtime that often depends on parallel resources, e.g., number of processes, and (2) a machine-learning model that extrapolates the parameters for calibrating our Markov model when we have changes in application parameters such as dataset. Along with the parallel calculation time, parallel computing platforms consume some data transfer time to communicate among different nodes. FiM-Com consists of a simulation queuing model to quickly estimate communication time. Our new modeling approach considers different design choices along multiple dimensions, namely (i) process-level parallelism, (ii) distribution of cores on multi-processor platform, (iii) application related parameters, and (iv) characteristics of datasets. The major contribution of our prediction approach is that FiM can provide an accurate prediction of parallel processing time for the datasets that have a much larger size than that of the training datasets. We evaluate our approach with NAS Parallel Benchmarks and real iterative data processing applications. We compare the predicted results (e.g., end-to-end execution time) with actual experimental measurements on a real distributed platform. We also compare our work with an existing prediction technique based on machine learning. We rank the number of processes according to the actual and predicted results from FiM and calculate the correlation between the actual and predicted rankings. Our results show that FiM obtains a high correlation in the range of 0.80 to 0.99, which indicates considerable accuracy of our technique. Such prediction provides data analysts a useful insight of optimal configuration of parallel resources (e.g., number of processes and number of cores) and also helps system designers to investigate the impact of changes in application parameters on system performance.

Performance Modeling for MPI Applications with Low Overhead Fine-Grained Profiling.

Hybrid Performance Modeling And Analyzing Of Parallel Systems

Profiling HPC Applications with Low Overhead and High Accuracy

Automated Performance Modeling of HPC Applications Using Machine Learning.

Power Profiling for Low Power Optimization Using New Computing Model

APMT: an Automatic Hardware Counter-Based Performance Modeling Tool for HPC Applications

Using Hardware Counter-Based Performance Model to Diagnose Scaling Issues of HPC Applications.

Power Profile Monitoring and Tracking Evolution of System-Wide HPC Workloads

Performance and power modeling and prediction using MuMMI and 10 machine learning methods

MPI Implementation Profiling for Better Application Performance

Efficient and Precise Profiling, Modeling and Management on Power and Performance for Power Constrained HPC Systems

Analyzing & modeling the performance in Xen-based virtual cluster environment

PROFPRED: A Compiler-Level IR Based Performance Prediction Framework for MPI Industrial Applications

Automatic Multi-Parameter Performance Modeling of HPC Applications on a New Sunway Supercomputer

Performance Prediction Of Hpc Applications On Intel Processors

Performance Modeling of OpenMP Program Based on LLVM Compilation Platform

New Performance Modeling Methods for Parallel Data Processing Applications.

Using Small-Scale History Data to Predict Large-Scale Performance of HPC Application

Performance and Power Modeling and Prediction Using MuMMI and Ten Machine Learning Methods

HPC Application Performance Prediction with Machine Learning on New Architectures

MPIPP: an automatic profile-guided parallel process placement toolset for SMP clusters and multiclusters.