Abstract:Load balancing plays a critical role in ensuring system stability and optimal performance, and as such, it has been a subject of extensive research across diverse computing domains, particularly in heterogeneous systems. Such systems integrate various computing devices with distinct architectures and computational power, each designed to execute a particular type of workload having diverse and immediate requirements. This research introduces a novel load balancing approach that utilizes machine learning to monitor the load distribution of heterogeneous systems in real-time. It estimates the load of the system's devices according to our proposed definition of the load. This definition provided us with an accurate measurement of the actual load, enabling our approach to detect imbalances and locate underloaded devices. Subsequently, our approach assigns applications to these underloaded devices to achieve load balance. We conducted a comparative analysis between our proposed approach and various established load balancing methods from diverse computing domains. This evaluation included three critical criteria: load balancing, workload execution time, and energy consumption. Additionally, we introduced a novel metric called "IMBALANCE" that quantifies the difference in load distribution among the system devices. We implemented each load balancing approach in a real-time heterogeneous system consisting of a master host and three worker servers each equipped with a Central Processing Unit and Graphical Processing Unit. To ensure a comprehensive validation of our approach, we conducted experiments in three distinct scenarios, involving different types of workloads having varying levels of computing intensity. The experimental results consistently demonstrate significant performance improvements of our approach across all scenarios. Our approach excels in minimizing system imbalance, which, in turn, enhances load balancing. This leads to reduced workload execution times and minimized device idle periods, ultimately improving energy efficiency.

A Machine-Learning Based Load Prediction Approach for Distributed Service-Oriented Applications

Microservice Auto-Scaling Algorithm Based on Workload Prediction in Cloud-Edge Collaboration Environment

Distributed Model Based on Data Partition and Load Balance Algorithm

Dynamic Load-Balance Model for Web Services

Prediction Based Load Balance Algorithm in Context-aware Application Server

Host load Prediction-based GMDH-EA and MMTP for Virtual Machines Load Balancing in Cloud Environment

Feature weighting based hierarchical probabilistic load forecasting in distributed collaborative network

Dynamic Load-balancing Using Prediction in a Parallel Object-oriented System

A Multi-step-ahead CPU Load Prediction Approach in Distributed System

Load Analysis and Prediction for Unanticipated Situations

A pattern fusion model for multi-step-ahead CPU load prediction

DALB: A Dynamic Application-Sensitive Load Balancing Algorithm

Combined machine learning forecasting method for short-term power load based on the dynamic weight adjustment

Load Balancing Algorithm for Middleware Database Cluster

Machine learning-driven energy-efficient load balancing for real-time heterogeneous systems

Asynchronous Distributed Optimal Load Scheduling Algorithm

Long-Term CPU Load Prediction

Load Balancing Strategy for SDN Multi-Controller Clusters Based on Load Prediction

A Hybrid Federated Learning Framework with Dynamic Task Allocation for Multi-Party Distributed Load Prediction

Dynamic Load Balancing Technology for Cloud-Oriented CDN

Dynamically Balancing Load with Overload Control for Microservices