Abstract:Predicting workloads in cloud computing is a significant challenge due to their complex, multidimensional, and highly variable nature. Assessing the accuracy of these predictions is critical, as this directly impacts management decisions that the infrastructure manager has to take in real-time to optimize resource utilization and meet Service Level Agreements (SLAs). Researchers and practitioners approached workload prediction as a time series problem using both statistical and Machine Learning (ML) methods. However, due to the volatile nature of the resource utilization patterns and the fact that new workloads constantly appear, developing robust solutions is still an open challenge. Furthermore, current solutions often only predict one single workload, completely lacking the capability for generalizing over new workload time series. These approaches fully counter the advantages of leveraging complex methods, as for every new workload, they need to train, validate, and test a separate model. In this paper, we offer a generalizable approach based on Transfer Learning concepts. We comprehensively evaluate different methods (statistical, Machine Learning, and Deep Learning based) for predicting the resource utilization of cloud workloads by testing them on new, unobserved time series data, thereby assessing their potential for practical applications through Transfer Learning. Specifically, we inspect the algorithms’ performance in predicting one or multiple time-stamps ahead, considering both CPU and memory usage. Our main findings indicate that the Deep Learning methods Long Short-Term Memory (LSTM) and Transformer are the most suitable methods for predicting different metrics and timestamps ahead for test data. Through Transfer Learning principles, we investigate how the models’ performance varies with out-of-distribution data. In predicting new, unseen workloads, complex models show some limits, even if LSTM still proves to work in specific cases. Overall, our research offers valuable insights that can help infrastructure managers make correct design decisions when predicting cloud workload resource usage.

Cloud Server Load Turning Point Prediction Based on Feature Enhanced Multi-task LSTM

Cloud Workload Turning Points Prediction via Cloud Feature-Enhanced Deep Learning

Long Short Term Memory Recurrent Neural Network (LSTM-RNN) Based Workload Forecasting Model For Cloud Datacenters

A novel approach to workload prediction using attention-based LSTM encoder-decoder network in cloud environment

Host Load Prediction with Long Short-Term Memory in Cloud Computing

Host Load Prediction with Bi-directional Long Short-Term Memory in Cloud Computing

Integrated Deep Learning Method for Workload and Resource Prediction in Cloud Systems

Towards Workload Trend Time Series Probabilistic Prediction Via Probabilistic Deep Learning.

EsDNN: Deep Neural Network based Multivariate Workload Prediction Approach in Cloud Environment

Esdnn: Deep Neural Network Based Multivariate Workload Prediction in Cloud Computing Environments

An Adaptive Prediction Approach Based on Workload Pattern Discrimination in the Cloud.

Deep Recurrent Model for Server Load and Performance Prediction in Data Center.

Multi-step-ahead Host Load Prediction with GRU Based Encoder-Decoder in Cloud Computing

CPU Load Prediction Using Support Vector Regression and Kalman Smoother for Cloud

Time Series Predictions for Cloud Workloads: A Comprehensive Evaluation

Improved LSTM-based Prediction Method for Highly Variable Workload and Resources in Clouds.

Multi-step-ahead Host Load Prediction Using Autoencoder and Echo State Networks in Cloud Computing.

An Online Model Integration Framework for Server Resource Workload Prediction

Towards Accurate Prediction for High-Dimensional and Highly-Variable Cloud Workloads with Deep Learning

Two-Stage Adaptive Classification Cloud Workload Prediction Based on Neural Networks

Workload time series prediction in storage systems: a deep learning based approach