Abstract:Summary Heterogeneous systems deliver high computing performance when effectively utilized. It is crucial to execute each application on the most suitable device while maintaining system balance. However, achieving equal distribution of the computing load is challenging due to variations in computing power and device architectures within the system. Moreover, scheduling applications at real‐time further complicates this task, as prior information about the submitted applications is absent. In this context, we introduce "Equalizer," a real‐time load balancer for heterogeneous systems. "Equalizer" leverages machine learning to continuously monitor the system's state, predicting optimal devices for application execution at runtime. It assigns applications to devices that minimize system imbalance. To quantify system imbalance, we propose a novel metric that reflects the disparity in computing loads across the system's devices. This metric is calculated using predicted execution times of applications. To validate the performance of "Equalizer," we conducted a comparative study against widely adopted approaches, namely Round Robin and Device Suitability. The experiments were performed on a heterogeneous cluster comprising a master host and three slave servers, equipped with a total of 4 central processing units (CPUs) and 4 graphics processing units (GPUs). All approaches were deployed on the cluster and evaluated using three distinct workloads categorized by their computing intensity: medium intensity, heavy intensity, and a combination of heavy and medium intensity, simulating real‐world scenarios. Each workload consisted of a set of 80 OpenCL applications with varying input data sizes. The experimental results demonstrate that "Equalizer" effectively minimized the system's imbalance, reduced the idle time of devices, and eliminated overloads. Moreover, "Equalizer" exhibited significant improvements in workload execution time, resource utilization, throughput, and energy consumption. Across all tested scenarios, "Equalizer" consistently outperformed alternative approaches, showcasing its robustness, adaptability to dynamic environments, and applicability in real‐world practice.

HEET: A Heterogeneity Measure to Quantify the Difference across Distributed Computing Systems

E2C: A Visual Simulator for Heterogeneous Computing Systems

E2C: A Visual Simulator to Reinforce Education of Heterogeneous Computing Systems

A new heuristic for task scheduling in heterogeneous computing environment

Heterogeneous MacroTasking (HeMT) for Parallel Processing in the Public Cloud

Applications Classification and Scheduling on Heterogeneous HPC Systems Using Experimental Research.

Energy-Efficient and Thermal-Aware Resource Management for Heterogeneous Datacenters

Machine learning-driven energy-efficient load balancing for real-time heterogeneous systems

Equalizer: Energy‐efficient machine learning‐based heterogeneous cluster load balancer

Enabling Privacy-Preserving, Compute- and Data-Intensive Computing using Heterogeneous Trusted Execution Environment

Optimizing Task Scheduling in Heterogeneous Computing Environments: A Comparative Analysis of CPU, GPU, and ASIC Platforms Using E2C Simulator

Load Balance Heuristics for Synchronous Iterative Applications on Heterogeneous Cluster Systems

A Performance Study of Task Scheduling Heuristics in HC Environment

Performance evaluation based on task division and scheduling in heterogeneous multi-core systems

A Holistic Heterogeneity-Aware Data Placement Scheme for Hybrid Parallel I/O Systems.

HSIP: A Novel Task Scheduling Algorithm for Heterogeneous Computing

Optimal Task Partition and State-Dependent Loading in Heterogeneous Two-Element Work Sharing System

Exploration of Performance and Energy Trade-offs for Heterogeneous Multicore Architectures

Evaluation of Task Scheduling Algorithms in Heterogeneous Computing Environments

A Task Parallel Programming Framework Based on Heterogeneous Computing Platforms

Performance-effective and low-complexity task scheduling for heterogeneous computing