Dynamic Load Balancing in Cloud Computing: Optimized RL-Based Clustering with Multi-Objective Optimized Task Scheduling

Ahmad Raza Khan
DOI: https://doi.org/10.3390/pr12030519
IF: 3.5
2024-03-05
Processes
Abstract:Dynamic load balancing in cloud computing is crucial for efficiently distributing workloads across available resources, ensuring optimal performance. This research introduces a novel dynamic load-balancing approach that leverages a deep learning model combining Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs) to calculate load values for each virtual machine (VM). The methodology aims to enhance cloud performance by optimizing task scheduling and stress distribution. The proposed model employs a dynamic clustering mechanism based on computed loads to categorize VMs into overloaded and underloaded clusters. To improve clustering efficiency, the approach integrates Reinforcement Learning (RL) with a sophisticated Hybrid Lyrebird Falcon Optimization (HLFO) algorithm. HLFO merges the Lyrebird Optimization Algorithm (LOA) and Falcon Optimization Algorithm (FOA), enhancing the effectiveness of load balancing. A Multi-Objective Hybrid Optimization model is introduced to optimize task scheduling while considering Quality of Service (QoS) parameters, including makespan minimization, energy consumption reduction, balanced CPU utilization, efficient memory usage, and task prioritization. The implementation, conducted in Python and CloudSim, demonstrates the model's ability to effectively allocate work between virtual machines (VMs) and physical machines (PMs), resulting in improved resource utilization, shortened makespan, enhanced CPU usage, and rigorous assessments affirming its efficacy. This research addresses the complexity of dynamic load balancing in cloud environments by combining deep learning, reinforcement learning, and hybrid optimization techniques, offering a comprehensive solution to optimize cloud performance under varying workloads and resource conditions.
engineering, chemical
What problem does this paper attempt to address?
### Problems the Paper Aims to Solve The paper "Dynamic Load Balancing in Cloud Computing: Optimized RL - based Clustering and Multi - objective Optimized Task Scheduling" aims to solve the complexity problems of dynamic load balancing in the cloud environment. Specifically, the paper focuses on the following key challenges: 1. **Complexity of Dynamic Load Balancing**: - Workloads in the cloud environment are dynamic and complex, and traditional load - balancing algorithms may not be able to handle these changes effectively. - A solution that can adapt to different workloads and resource conditions is required. 2. **Conflicting Objectives**: - A balance needs to be found among multiple Quality of Service (QoS) parameters, such as minimizing the makespan, reducing energy consumption, balancing CPU utilization, efficient memory use, and task priority. 3. **Implementation Challenges**: - There are technical challenges in the integration and implementation of deep learning, reinforcement learning, and hybrid optimization algorithms. - Ensure that the algorithm can effectively adapt to dynamic workloads in practical applications and has scalability to deal with larger cloud environments. ### Solutions To solve the above problems, the paper proposes a new dynamic load - balancing method with the following main features: 1. **Deep Learning Model**: - Use a deep - learning model that combines Convolutional Neural Network (CNN) and Recurrent Neural Network (RNN) to calculate the load value of each virtual machine (VM). - CNN is used to extract features from sensor data, especially for processing spatial information in Wireless Sensor Networks (WSN). - RNN is used to process sequential data and capture the relationship of sensor readings changing over time, which is very important for load calculation in dynamic environments. 2. **Dynamic Clustering Mechanism**: - Based on the calculated load values, divide VMs into over - loaded and under - utilized clusters. - Improve clustering efficiency through Reinforcement Learning (RL) and Advanced Hybrid Lyrebird Falcon Optimization (HLFO). - The HLFO algorithm combines the Lyrebird Optimization Algorithm (LOA) and the Falcon Optimization Algorithm (FOA) to enhance the effectiveness of load balancing. 3. **Multi - objective Hybrid Optimization Model**: - Introduce a multi - objective hybrid optimization model to optimize task scheduling, considering QoS parameters, including minimizing the makespan, reducing energy consumption, balancing CPU utilization, efficient memory use, and task priority. - Implement the model through Python and CloudSim to verify its effectiveness in allocating workloads, shortening the makespan, and increasing CPU utilization. ### Summary This research provides a comprehensive solution by combining deep learning, reinforcement learning, and hybrid optimization techniques, aiming to optimize dynamic load balancing in the cloud environment, improve cloud performance, and ensure consistency and effectiveness under different workloads and resource conditions.