Abstract:Due to the rapid growth of available data, various platforms offer parallel infrastructure that efficiently processes big data. One of the critical issues is how to use these platforms to optimise resources, and for this reason, performance prediction has been an important topic in the last few years. There are two main approaches to the problem of predicting performance. One is to fit data into an equation based on a analytical models. The other is to use machine learning (ML) in the form of regression algorithms. In this paper, we have investigated the difference in accuracy for these two approaches. While our experiments used an open-source platform called Apache Spark, the results obtained by this research are applicable to any parallel platform and are not constrained to this technology. We found that gradient boost, an ML regressor, is more accurate than any of the existing analytical models as long as the range of the prediction follows that of the training. We have investigated analytical and ML models based on interpolation and extrapolation methods with k-fold cross-validation techniques. Using the interpolation method, two analytical models, namely 2D-plate and fully-connected models, outperform older analytical models and kernel ridge regression algorithm but not the gradient boost regression algorithm. We found the average accuracy of 2D-plate and fully-connected models using interpolation are 0.962 and 0.961. However, when using the extrapolation method, the analytical models are much more accurate than the ML regressors, particularly two of the most recently proposed models (2D-plate and fully-connected). Both models are based on the communication patterns between the nodes. We found that using extrapolation, kernel ridge, gradient boost and two proposed analytical models average accuracy is 0.466, 0.677, 0.975, and 0.981, respectively. This study shows that practitioners can benefit from analytical models by being able to accurately predict the runtime outside of the range of the training data using only a few experimental operations.

Performance Prediction of Spark Based on the Multiple Linear Regression Analysis.

Machine Learning for Performance Prediction of Spark Cloud Applications

Power Load Prediction Model Based on Long Short Term Memory and Sparrow Search Algorithm

Experimental Analysis and Comparison of Load Prediction Algorithms in Cloud Data Center

A Gray-Box Performance Model for Apache Spark

Short-term load forecasting with clustering–regression model in distributed cluster

CloudProphet: A Machine Learning-Based Performance Prediction for Public Clouds

Sports performance prediction model based on integrated learning algorithm and cloud computing Hadoop platform

The Prediction of Spark-Ignition Engine Performance and Emissions Based on the SVR Algorithm

Performance Analysis of Machine Learning Centered Workload Prediction Models for Cloud

Neural-based Modeling for Performance Tuning of Spark Data Analytics

A Multivariate Regression Load Forecasting Algorithm Based on Variable Accuracy Feedback

Comparison and Improvement of Hadoop MapReduce Performance Prediction Models in the Private Cloud.

A Method to Identify Spark Important Parameters Based on Machine Learning.

A STATISTICAL REGRESSION-BASED APPROACH FOR PERFORMANCE PREDICTION IN MULTI-TIER APPLICATIONS

Runtime prediction of big data jobs: performance comparison of machine learning algorithms and analytical models

Cloud Performance Trend Prediction by Moving Averages

HPC Application Performance Prediction with Machine Learning on New Architectures

Cloud Computing: A Model Construct of Real-Time Monitoring for Big Dataset Analytics Using Apache Spark

Host Load Prediction with Long Short-Term Memory in Cloud Computing

A performance prediction scheme for computation-intensive applications on cloud