Abstract:Resource management in data centres continues to be a critical problem due to increased infrastructure complexity and dynamic workload conditions. Workload and energy consumption prediction are crucial for efficient resource management decisions in cloud data centres. Existing solutions only consider forecasting the usage of virtual machine resources such as CPU and memory; they do not consider provisioned resources (CPU and memory) and disk, network transmission rates, which significantly affect the energy consumption of the host as well. VM-level energy consumption can be estimated for automated energy management decisions in modern data centres. However, it is not easy to measure energy for VM devices such as CPU, memory, and disk at the software level. In this way, we propose an ML-based model to predict load and energy to aid resource management decisions. For modelling workload predictions, we investigated several distinctive ML algorithms such as Linear Regression (LR), Ridge Regression (RR), ARD Regression (ARDR), ElasticNet (EN) and deep learning (DL) algorithm like Gated Recurrent Unit (GRU). The model’s predictions are measured using standard evaluation metrics like root mean square error (RMSE). We have discovered that GRU has performed very well by accomplishing the most negligible RMSE value for all the workload performances based on experimental results. For energy state estimation, we propose four diverse clustering algorithms, including, semi-supervised affinity propagation based on transfer learning (TSSAP), CLA based on transfer learning (TCLA), kmeans based on transfer learning (TKmeans), P-teda based on transfer learning (TP-teda) to discover similar groups of VMs dependent on features that may influence energy consumption as opposed to estimating it for each VM. The TSSAP has acquired promising clustering accuracy with 87.48% and 53.80% in identifying the VM classes which have been calculated using standard metric such as micro-precision for the chosen workload in compassion to affinity propagation (AP) and the average of other proposed clustering algorithms respectively.

A novel prediction approach based on three-way decision for cloud datacenters

Three-Way Ensemble Prediction for Workload in the Data Center

Reasoning Based Workload Performance Prediction in Cloud Data Centers

A novel approach to workload prediction using attention-based LSTM encoder-decoder network in cloud environment

A Multi-Output Prediction Model for Physical Machine Resource Usage in Cloud Data Centers

EsDNN: Deep Neural Network based Multivariate Workload Prediction Approach in Cloud Environment

A Self-Adaptive Prediction Algorithm for Cloud Workloads

A Novel Approach for CPU Load Prediction of Cloud Server Combining Denoising and Error Correction.

Towards Workload Trend Time Series Probabilistic Prediction Via Probabilistic Deep Learning.

Performance Analysis of Machine Learning Centered Workload Prediction Models for Cloud

Load Prediction for Data Centers Based on Database Service.

Long Short Term Memory Recurrent Neural Network (LSTM-RNN) Based Workload Forecasting Model For Cloud Datacenters

Benchmarking and Revisiting Time Series Forecasting Methods in Cloud Workload Prediction

A Prediction-Based Multi-Objective VM Consolidation Approach for Cloud Data Centers

Tr-Predictior: An Ensemble Transfer Learning Model for Small-Sample Cloud Workload Prediction

Cloud Workload Turning Points Prediction via Cloud Feature-Enhanced Deep Learning

Cloud Resource Demand Prediction Based on VMD-GRU-TCN Hybrid Model.

A Big Data Processing-Oriented Prediction Method of Cloud Computing Service Request

Workload Forecasting and Energy State Estimation in Cloud Data Centres: ML-centric Approach

Workload prediction based on improved error correlation logistic regression algorithm and Cross‐TRCN of spatiotemporal neural network

Online Cloud Resource Prediction Via Scalable Window Waveform Sampling on Classified Workloads.