Abstract:Predicting the performance of an application running on parallel computing platforms is increasingly becoming important because of its influence on development time and resource management. However, predicting the performance with respect to parallel processes is complex for iterative and multi-stage applications. This research proposes a performance approximation approach FiM to predict the calculation time with FiM-Cal and communication time with FiM-Com of an application running on a distributed framework. FiM-Cal consists of two key components that are coupled with each other: (1) a Stochastic Markov Model to capture non-deterministic runtime that often depends on parallel resources, e.g., number of processes, and (2) a machine-learning model that extrapolates the parameters for calibrating our Markov model when we have changes in application parameters such as dataset. Along with the parallel calculation time, parallel computing platforms consume some data transfer time to communicate among different nodes. FiM-Com consists of a simulation queuing model to quickly estimate communication time. Our new modeling approach considers different design choices along multiple dimensions, namely (i) process-level parallelism, (ii) distribution of cores on multi-processor platform, (iii) application related parameters, and (iv) characteristics of datasets. The major contribution of our prediction approach is that FiM can provide an accurate prediction of parallel processing time for the datasets that have a much larger size than that of the training datasets. We evaluate our approach with NAS Parallel Benchmarks and real iterative data processing applications. We compare the predicted results (e.g., end-to-end execution time) with actual experimental measurements on a real distributed platform. We also compare our work with an existing prediction technique based on machine learning. We rank the number of processes according to the actual and predicted results from FiM and calculate the correlation between the actual and predicted rankings. Our results show that FiM obtains a high correlation in the range of 0.80 to 0.99, which indicates considerable accuracy of our technique. Such prediction provides data analysts a useful insight of optimal configuration of parallel resources (e.g., number of processes and number of cores) and also helps system designers to investigate the impact of changes in application parameters on system performance.

Building a Framework for Predictive Science

Predictive performance and scalability modeling of a large-scale application

Adaptive Computing for Scale-up Problems

A Gradient-Based Uncertainty Optimization Framework Utilizing Dimensional Adaptive Polynomial Chaos Expansion

Parallelization and High-Performance Computing Enables Automated Statistical Inference of Multi-scale Models.

Modern, Efficient, and Differentiable Transport Equation Models using JAX: Applications to Population Balance Equations

From Physics Model to Results: An Optimizing Framework for Cross-Architecture Code Generation

Multiscale modeling of materials: Computing, data science,uncertainty and goal-oriented optimization

Prediction models for multi-dimensional power-performance optimization on many cores

A performance spectrum for parallel computational frameworks that solve PDEs

End-to-end AI framework for interpretable prediction of molecular and crystal properties

Multifidelity Surrogate Based on Single Linear Regression

Machine Learning-Encoded Multiscale Modelling and Bayesian Optimization Framework to Design Programmable Metamaterials

Accelerated scale-bridging through adaptive surrogate model evaluation

Multi-Fidelity Surrogate Based on Single Linear Regression

From Prescriptive to Predictive: an Interdisciplinary Perspective on the Future of Computational Chemistry

New Performance Modeling Methods for Parallel Data Processing Applications.

A State-of-the-Art Review on Machine Learning-Based Multiscale Modeling, Simulation, Homogenization and Design of Materials

A Structural Optimization Framework for Multidisciplinary Design