Abstract:Predicting the performance of an application running on parallel computing platforms is increasingly becoming important because of its influence on development time and resource management. However, predicting the performance with respect to parallel processes is complex for iterative and multi-stage applications. This research proposes a performance approximation approach FiM to predict the calculation time with FiM-Cal and communication time with FiM-Com of an application running on a distributed framework. FiM-Cal consists of two key components that are coupled with each other: (1) a Stochastic Markov Model to capture non-deterministic runtime that often depends on parallel resources, e.g., number of processes, and (2) a machine-learning model that extrapolates the parameters for calibrating our Markov model when we have changes in application parameters such as dataset. Along with the parallel calculation time, parallel computing platforms consume some data transfer time to communicate among different nodes. FiM-Com consists of a simulation queuing model to quickly estimate communication time. Our new modeling approach considers different design choices along multiple dimensions, namely (i) process-level parallelism, (ii) distribution of cores on multi-processor platform, (iii) application related parameters, and (iv) characteristics of datasets. The major contribution of our prediction approach is that FiM can provide an accurate prediction of parallel processing time for the datasets that have a much larger size than that of the training datasets. We evaluate our approach with NAS Parallel Benchmarks and real iterative data processing applications. We compare the predicted results (e.g., end-to-end execution time) with actual experimental measurements on a real distributed platform. We also compare our work with an existing prediction technique based on machine learning. We rank the number of processes according to the actual and predicted results from FiM and calculate the correlation between the actual and predicted rankings. Our results show that FiM obtains a high correlation in the range of 0.80 to 0.99, which indicates considerable accuracy of our technique. Such prediction provides data analysts a useful insight of optimal configuration of parallel resources (e.g., number of processes and number of cores) and also helps system designers to investigate the impact of changes in application parameters on system performance.

An iterative clustering based approach for parallel performance analysis

A Parallel Hierarchical Clustering Algorithm for PCs Cluster System.

A parallel computing method for irregular work

Parallel Boosted Clustering

A Parallel K-Means Clustering Algorithm with MPI

Improving the Energy Efficiency of Data-Intensive Applications Running on Clusters

PARCLE: a Parallel Clustering Algorithm for Cluster System

An Approach to Enhance the Performance of Large‐scale Structural Analysis on CPU‐MIC Heterogeneous Clusters

New Performance Modeling Methods for Parallel Data Processing Applications.

A Collaborative Filtering Based Approach To Performance Prediction For Parallel Applications

A Parallel Clustering Algorithm for Power Big Data Analysis.

Research on Application-driven Parallel Program Performance Tuning

- 1-Application Performance Prediction for the Management and Scheduling of Clusters and Grids

An Efficient Parallel Anomaly Detection Algorithm Based on Hierarchical Clustering.

High-Performance Genomic Analysis Heterogeneous System Using OpenCL

An efficient parallel ISODATA algorithm based on Kepler GPUs

PROBING PARALLEL TECHNIQUE-BASED STATISTICAL ANALYSIS FOR ENORMOUS DATA

A New Hybrid Hierarchical Parallel Algorithm to Enhance the Performance of Large-Scale Structural Analysis Based on Heterogeneous Multicore Clusters

A Parallel Programming Interface for Out-of-core Cluster Applications

Parallel Optimization for Clustering Algorithm of Large-Scale Biological Effect Evaluation

Performance modeling of parallel and distributed computing using PACE