Abstract:Scheduling job flows efficiently and rapidly on distributed computing clusters is one of huge challenges for daily operation of data centers. In a practical scenario, a single job consists of numerous stages with complex dependency relation represented as a Directed Acyclic Graph (DAG) structure. Nowadays a data center usually equips with a cluster of heterogeneous computing servers which are different in the hardware/software configuration. From both the cost saving and environmental friendliness, the data centers could benefit a lot from optimizing the job scheduling problems in the heterogeneous environment. Thus the problem has attracted more and more attention from both the industry and academy. In this paper, we propose a task-duplication based learning algorithm, namely \lachesis \footnote{The second of the Three Fates in ancient Greek mythology, who determines destiny.}, aiming to optimize the problem. In the proposed approach, it first perceives the topological dependencies between jobs using a reinforcement learning framework and a specially designed graph neural network (GNN) to select the most promising task to be executed. Then the task is assigned to a specific executor with the consideration of duplicating all its precedent tasks according to an expert-designed rules. We have conducted extensive experiments over standard workloads to evaluate the proposed solution. The experimental results suggest that \lachesisquad can achieve at most 26.7\% reduction of makespan and 35.2\% improvement of speedup ratio over seven strong baseline algorithms, including the state-of-the-art heuristics methods and a variety of deep reinforcement learning based algorithms.

Scheduling Generative-AI Job DAGs with Model Serving in Data Centers

A Load Balance Scheduling Approach for Generative AI on Cloud-Native Environments with Heterogeneous Resources

Sustainable AIGC Workload Scheduling of Geo-Distributed Data Centers: A Multi-Agent Reinforcement Learning Approach

Two-stage scheduling of integrated energy systems based on a two-step DCGAN-based scenario prediction approach

Online AI-Generated Content Request Scheduling with Deep Reinforcement Learning

Genetic Programming for Dynamic Workflow Scheduling in Fog Computing

Multi-workflow scheduling in industrial edge: a genetic algorithm with heuristic strategy.

Online Scheduling of Machine Learning Jobs in Edge-Cloud Networks

Edge Generation Scheduling for DAG Tasks Using Deep Reinforcement Learning

DAG Scheduling in Mobile Edge Computing

On-demand Edge Inference Scheduling with Accuracy and Deadline Guarantee.

Octopus: an End-to-end Multi-DAG Scheduling Method Based on Deep Reinforcement Learning

Learning to Schedule DAG Tasks

Online Dag Scheduling With On-Demand Function Configuration In Edge Computing

Telemetry-aided cooperative multi-agent online reinforcement learning for DAG task scheduling in computing power networks

A learning and evolution-based intelligence algorithm for multi-objective heterogeneous cloud scheduling optimization

Joint Model Assignment and Resource Allocation for Cost-Effective Mobile Generative Services

A Reinforcement Learning Based Job Scheduling Algorithm for Heterogeneous Computing Environment

A Scheduling Scheme in a Container-Based Edge Computing Environment Using Deep Reinforcement Learning Approach.

New Model And Genetic Algorithm For Multi-Installment Divisible-Load Scheduling

Learning to Optimize DAG Scheduling in Heterogeneous Environment