Abstract:The rapid development of artificial intelligence in multiple scenarios, including machine learning, image recognition, and autonomous driving, has led to an explosion of computation jobs. These jobs are often divided into parallel child tasks and executed in distributed clusters with limited computing resources, making parallel task scheduling one of the most important research topics nowadays. Most studies about parallel task scheduling focused on formulating special scenarios and service requirements as optimization problems. However, the complicated and dynamic parallel computing environments are hard to model, predict and control, making those previous methods unscalable and unable to reflect the real scenarios. In this paper, a Multi-task Deep reinforcement learning approach for scalable parallel Task Scheduling (MDTS) is firstly devised. Generally, Deep Reinforcement Learning (DRL) is a model-free optimization algorithm for long-term control by leveraging experience, but it suffers the curse of dimensionality for decision when coping with complex parallel computing environments and jobs with diverse properties. We extend the action selection in DRL to a multi-task decision, where the output branches of multitask learning are fine-matched to parallel scheduling tasks. Child tasks of a job are accordingly assigned to distributed nodes without any human knowledge while the resource competition among parallel tasks is leveraged through shared neural network layers. Extensive experiments show that the MDTS significantly reduces the job execution time compared with least-connection scheduling and particle swarm optimization algorithm by 15.3% and 39.8% respectively. Moreover, MDTS outperforms the raw DRL algorithm on job execution time, load imbalance value, and total cost by 42.8%, 47.5%, and 59.0%.

HeterPS: Distributed deep learning with reinforcement learning based scheduling in heterogeneous environments

HeterPS: Distributed Deep Learning With Reinforcement Learning Based Scheduling in Heterogeneous Environments

Adaptive Partitioning and Efficient Scheduling for Distributed DNN Training in Heterogeneous IoT Environment

A Scheduling Algorithm Based on Reinforcement Learning for Heterogeneous Environments.

Joint Dynamic Data and Model Parallelism for Distributed Training of DNNs over Heterogeneous Infrastructure

H-PS: A Heterogeneous-Aware Parameter Server With Distributed Neural Network Training

RLPTO : A reinforcement learning-based performance-time optimized task and resource scheduling mechanism for distributed machine learning

Energy-aware Task Scheduling Optimization with Deep Reinforcement Learning for Large-Scale Heterogeneous Systems

DDDQN‐TS: A Task Scheduling and Load Balancing Method Based on Optimized Deep Reinforcement Learning in Heterogeneous Computing Environment

Scheduling-Efficient Framework for Neural Network on Heterogeneous Distributed Systems and Mobile Edge Computing Systems

Heterogeneous Resource Scheduling in Computing Power Networks: A Method Based on Improved D3QN

Scheduling Distributed Deep Learning Jobs in Heterogeneous Cluster with Placement Awareness

A Deep Reinforcement Learning Scheduling Algorithm for Heterogeneous Tasks on Heterogeneous Multi-Core Processors

A Reinforcement Learning Based Job Scheduling Algorithm for Heterogeneous Computing Environment

DRL-TA: A Type-aware Task Scheduling and Load Balancing Method based on Deep Reinforcement Learning in Heterogeneous Computing Environment.

Heterogeneity-Aware Distributed Parameter Servers

Heterogeneous Task Oriented Data Scheduling in Vehicular Edge Computing Via Deep Reinforcement Learning

Multi-task Deep Reinforcement Learning for Scalable Parallel Task Scheduling.

Toward Heterogeneous Environment: Lyapunov-Orientated ImpHetero Reinforcement Learning for Task Offloading

Scalable Heterogeneous Scheduling Based Model Parallelism for Real-Time Inference of Large-Scale Deep Neural Networks

A Dual-Agent Scheduler for Distributed Deep Learning Jobs on Public Cloud Via Reinforcement Learning