Abstract:Resource management in data centres continues to be a critical problem due to increased infrastructure complexity and dynamic workload conditions. Workload and energy consumption prediction are crucial for efficient resource management decisions in cloud data centres. Existing solutions only consider forecasting the usage of virtual machine resources such as CPU and memory; they do not consider provisioned resources (CPU and memory) and disk, network transmission rates, which significantly affect the energy consumption of the host as well. VM-level energy consumption can be estimated for automated energy management decisions in modern data centres. However, it is not easy to measure energy for VM devices such as CPU, memory, and disk at the software level. In this way, we propose an ML-based model to predict load and energy to aid resource management decisions. For modelling workload predictions, we investigated several distinctive ML algorithms such as Linear Regression (LR), Ridge Regression (RR), ARD Regression (ARDR), ElasticNet (EN) and deep learning (DL) algorithm like Gated Recurrent Unit (GRU). The model’s predictions are measured using standard evaluation metrics like root mean square error (RMSE). We have discovered that GRU has performed very well by accomplishing the most negligible RMSE value for all the workload performances based on experimental results. For energy state estimation, we propose four diverse clustering algorithms, including, semi-supervised affinity propagation based on transfer learning (TSSAP), CLA based on transfer learning (TCLA), kmeans based on transfer learning (TKmeans), P-teda based on transfer learning (TP-teda) to discover similar groups of VMs dependent on features that may influence energy consumption as opposed to estimating it for each VM. The TSSAP has acquired promising clustering accuracy with 87.48% and 53.80% in identifying the VM classes which have been calculated using standard metric such as micro-precision for the chosen workload in compassion to affinity propagation (AP) and the average of other proposed clustering algorithms respectively.

Workload Forecasting Method in Cloud

Workload Forecasting Framework for Applications in Cloud

Experimental Analysis and Comparison of Load Prediction Algorithms in Cloud Data Center

Performance Analysis of Machine Learning Centered Workload Prediction Models for Cloud

A novel workload forecasting model for cloud computing using ALAA-DBN algorithm

Three-Way Ensemble Prediction for Workload in the Data Center

Host Load Prediction Based on PSR and EA-GMDH for Cloud Computing System

Cpu Load Prediction for Cloud Environment Based on A Dynamic Ensemble Model

Load forecast of resource scheduler in cloud architecture

A novel approach to workload prediction using attention-based LSTM encoder-decoder network in cloud environment

Host Load Prediction with Long Short-Term Memory in Cloud Computing

EsDNN: Deep Neural Network based Multivariate Workload Prediction Approach in Cloud Environment

Auto-Scaling Provision Basing on Workload Prediction in the Virtualized Data Center

Forecasting Workload in Cloud Computing: Towards Uncertainty-Aware Predictions and Transfer Learning

Survey on prediction models in cloud resource management schemes

Dynamic Virtual Resource Management in Clouds Coping with Traffic Burst

An efficient forecasting approach for resource utilization in cloud data center using CNN-LSTM model

Workload Forecasting and Energy State Estimation in Cloud Data Centres: ML-centric Approach

Long Short Term Memory Recurrent Neural Network (LSTM-RNN) Based Workload Forecasting Model For Cloud Datacenters

Energy efficient job scheduling with workload prediction on cloud data center

Multi-step-ahead Host Load Prediction Using Autoencoder and Echo State Networks in Cloud Computing.