Abstract:The rapid development of artificial intelligence in multiple scenarios, including machine learning, image recognition, and autonomous driving, has led to an explosion of computation jobs. These jobs are often divided into parallel child tasks and executed in distributed clusters with limited computing resources, making parallel task scheduling one of the most important research topics nowadays. Most studies about parallel task scheduling focused on formulating special scenarios and service requirements as optimization problems. However, the complicated and dynamic parallel computing environments are hard to model, predict and control, making those previous methods unscalable and unable to reflect the real scenarios. In this paper, a Multi-task Deep reinforcement learning approach for scalable parallel Task Scheduling (MDTS) is firstly devised. Generally, Deep Reinforcement Learning (DRL) is a model-free optimization algorithm for long-term control by leveraging experience, but it suffers the curse of dimensionality for decision when coping with complex parallel computing environments and jobs with diverse properties. We extend the action selection in DRL to a multi-task decision, where the output branches of multitask learning are fine-matched to parallel scheduling tasks. Child tasks of a job are accordingly assigned to distributed nodes without any human knowledge while the resource competition among parallel tasks is leveraged through shared neural network layers. Extensive experiments show that the MDTS significantly reduces the job execution time compared with least-connection scheduling and particle swarm optimization algorithm by 15.3% and 39.8% respectively. Moreover, MDTS outperforms the raw DRL algorithm on job execution time, load imbalance value, and total cost by 42.8%, 47.5%, and 59.0%.

On the Power of Multitask Representation Learning in Linear MDP

Provable Benefit of Multitask Representation Learning in Reinforcement Learning

Provable Benefits of Multi-task RL under Non-Markovian Decision Making Processes

The Power of Active Multi-Task Learning in Reinforcement Learning from Human Feedback

Provable General Function Class Representation Learning in Multitask Bandits and MDPs

Offline Multitask Representation Learning for Reinforcement Learning

Learning Functions to Study the Benefit of Multitask Learning

Improved Active Multi-Task Representation Learning via Lasso

Regret Analysis of Multi-task Representation Learning for Linear-Quadratic Adaptive Control

Multi-task Deep Reinforcement Learning for Scalable Parallel Task Scheduling.

Multi-task Batch Reinforcement Learning with Metric Learning

A Decentralized Policy Gradient Approach to Multi-task Reinforcement Learning

Sample Efficient Myopic Exploration Through Multitask Reinforcement Learning with Diverse Tasks

Bootstrap Latent-Predictive Representations for Multitask Reinforcement Learning

Provable Multi-Task Representation Learning by Two-Layer ReLU Neural Networks

Multi-task Representation Learning for Mixed Integer Linear Programming

Near-Optimal Representation Learning For Linear Bandits And Linear Rl

AdaTask: A Task-aware Adaptive Learning Rate Approach to Multi-task Learning

Multi-Task Reinforcement Learning with Mixture of Orthogonal Experts

Representation Learning for Online and Offline RL in Low-rank MDPs