Abstract:Resource management in data centres continues to be a critical problem due to increased infrastructure complexity and dynamic workload conditions. Workload and energy consumption prediction are crucial for efficient resource management decisions in cloud data centres. Existing solutions only consider forecasting the usage of virtual machine resources such as CPU and memory; they do not consider provisioned resources (CPU and memory) and disk, network transmission rates, which significantly affect the energy consumption of the host as well. VM-level energy consumption can be estimated for automated energy management decisions in modern data centres. However, it is not easy to measure energy for VM devices such as CPU, memory, and disk at the software level. In this way, we propose an ML-based model to predict load and energy to aid resource management decisions. For modelling workload predictions, we investigated several distinctive ML algorithms such as Linear Regression (LR), Ridge Regression (RR), ARD Regression (ARDR), ElasticNet (EN) and deep learning (DL) algorithm like Gated Recurrent Unit (GRU). The model’s predictions are measured using standard evaluation metrics like root mean square error (RMSE). We have discovered that GRU has performed very well by accomplishing the most negligible RMSE value for all the workload performances based on experimental results. For energy state estimation, we propose four diverse clustering algorithms, including, semi-supervised affinity propagation based on transfer learning (TSSAP), CLA based on transfer learning (TCLA), kmeans based on transfer learning (TKmeans), P-teda based on transfer learning (TP-teda) to discover similar groups of VMs dependent on features that may influence energy consumption as opposed to estimating it for each VM. The TSSAP has acquired promising clustering accuracy with 87.48% and 53.80% in identifying the VM classes which have been calculated using standard metric such as micro-precision for the chosen workload in compassion to affinity propagation (AP) and the average of other proposed clustering algorithms respectively.

VM Power Prediction in Distributed Systems for Maximizing Renewable Energy Usage

Renewable Energy Prediction using Weather Forecasts for Optimal Scheduling in HPC Systems

Power Profile Monitoring and Tracking Evolution of System-Wide HPC Workloads

Predictive Data and Energy Management under Budget

A Tree Regression-Based Approach for VM Power Metering

Energy Efficient Allocation of Virtual Machines in Cloud Computing Environments Based on Demand Forecast.

Power Consumption Modeling and Prediction in a Hybrid CPU-GPU-MIC Supercomputer (preliminary version)

Workload Forecasting and Energy State Estimation in Cloud Data Centres: ML-centric Approach

GreenBytes: Intelligent Energy Estimation for Edge-Cloud

EEDVMI: Energy-Efficient Dynamic Virtual Machines Integration

A proactive autoscaling and energy-efficient VM allocation framework using online multi-resource neural network for cloud data center

Modeling and Predicting Power Consumption of High Performance Computing Jobs

Predicting System-level Power for a Hybrid Supercomputer

Adaptive Vm Management with Two Phase Power Consumption Cost Models in Cloud Datacenter

Resource optimization using predictive virtual machine consolidation approach in cloud environment

A Genetic Algorithm for Power-Aware Virtual Machine Allocation in Private Cloud

Power Modeling for Effective Datacenter Planning and Compute Management

A Robust Power Model Training Framework for Cloud Native Runtime Energy Metric Exporter

Prediction of Performance and Power Consumption of GPGPU Applications

Towards Automated Provisioning and Emergency Handling in Renewable Energy Powered Datacenters.

Optimizing Resource Consumption and Reducing Power Usage in Data Centers, A Novel Mathematical VM Replacement Model and Efficient Algorithm