Abstract:Predicting workloads in cloud computing is a significant challenge due to their complex, multidimensional, and highly variable nature. Assessing the accuracy of these predictions is critical, as this directly impacts management decisions that the infrastructure manager has to take in real-time to optimize resource utilization and meet Service Level Agreements (SLAs). Researchers and practitioners approached workload prediction as a time series problem using both statistical and Machine Learning (ML) methods. However, due to the volatile nature of the resource utilization patterns and the fact that new workloads constantly appear, developing robust solutions is still an open challenge. Furthermore, current solutions often only predict one single workload, completely lacking the capability for generalizing over new workload time series. These approaches fully counter the advantages of leveraging complex methods, as for every new workload, they need to train, validate, and test a separate model. In this paper, we offer a generalizable approach based on Transfer Learning concepts. We comprehensively evaluate different methods (statistical, Machine Learning, and Deep Learning based) for predicting the resource utilization of cloud workloads by testing them on new, unobserved time series data, thereby assessing their potential for practical applications through Transfer Learning. Specifically, we inspect the algorithms’ performance in predicting one or multiple time-stamps ahead, considering both CPU and memory usage. Our main findings indicate that the Deep Learning methods Long Short-Term Memory (LSTM) and Transformer are the most suitable methods for predicting different metrics and timestamps ahead for test data. Through Transfer Learning principles, we investigate how the models’ performance varies with out-of-distribution data. In predicting new, unseen workloads, complex models show some limits, even if LSTM still proves to work in specific cases. Overall, our research offers valuable insights that can help infrastructure managers make correct design decisions when predicting cloud workload resource usage.

Improved LSTM-based Prediction Method for Highly Variable Workload and Resources in Clouds.

Adaptive Prediction of Resources and Workloads for Cloud Computing Systems with Attention-based and Hybrid LSTM.

Accurate Prediction of Workloads and Resources with Multi-Head Attention and Hybrid LSTM for Cloud Data Centers

An Improved LSTM-Based Prediction Approach for Resources and Workload in Large-scale Data Centers

Integrated Deep Learning Method for Workload and Resource Prediction in Cloud Systems

Host Load Prediction with Bi-directional Long Short-Term Memory in Cloud Computing

Temporal Prediction of Multiapplication Consolidated Workloads in Distributed Clouds

Host Load Prediction with Long Short-Term Memory in Cloud Computing

Time Series Predictions for Cloud Workloads: A Comprehensive Evaluation

Towards Accurate Prediction for High-Dimensional and Highly-Variable Cloud Workloads with Deep Learning

A novel approach to workload prediction using attention-based LSTM encoder-decoder network in cloud environment

Accurate workload prediction for edge data centers: Savitzky-Golay filter, CNN and BiLSTM with attention mechanism

ARIMA-Based and Multiapplication Workload Prediction with Wavelet Decomposition and Savitzky–Golay Filter in Clouds

Time-Dependent Cloud Workload Forecasting Via Multi-Task Learning.

Towards Workload Trend Time Series Probabilistic Prediction Via Probabilistic Deep Learning.

An Adaptive Prediction Approach Based on Workload Pattern Discrimination in the Cloud.

E2LG: a multiscale ensemble of LSTM/GAN deep learning architecture for multistep-ahead cloud workload prediction

GRU-ES: Resource Usage Prediction of Cloud Workloads Using a Novel Hybrid Method.

Forecasting Workload in Cloud Computing: Towards Uncertainty-Aware Predictions and Transfer Learning

CPU Load Prediction Using Support Vector Regression and Kalman Smoother for Cloud

Long Short Term Memory Recurrent Neural Network (LSTM-RNN) Based Workload Forecasting Model For Cloud Datacenters