Abstract:As human-robot collaboration increases in the workforce, it becomes essential for human-robot teams to coordinate efficiently and intuitively. Traditional approaches for human-robot scheduling either utilize exact methods that are intractable for large-scale problems and struggle to account for stochastic, time varying human task performance, or application-specific heuristics that require expert domain knowledge to develop. We propose a deep learning-based framework, called HybridNet, combining a heterogeneous graph-based encoder with a recurrent schedule propagator for scheduling stochastic human-robot teams under upper- and lower-bound temporal constraints. The HybridNet's encoder leverages Heterogeneous Graph Attention Networks to model the initial environment and team dynamics while accounting for the constraints. By formulating task scheduling as a sequential decision-making process, the HybridNet's recurrent neural schedule propagator leverages Long Short-Term Memory (LSTM) models to propagate forward consequences of actions to carry out fast schedule generation, removing the need to interact with the environment between every task-agent pair selection. The resulting scheduling policy network provides a computationally lightweight yet highly expressive model that is end-to-end trainable via Reinforcement Learning algorithms. We develop a virtual task scheduling environment for mixed human-robot teams in a multi-round setting, capable of modeling the stochastic learning behaviors of human workers. Experimental results showed that HybridNet outperformed other human-robot scheduling solutions across problem sizes for both deterministic and stochastic human performance, with faster runtime compared to pure-GNN-based schedulers.

Heterogeneous graph attention networks for scalable multi-robot scheduling with temporospatial constraints

Learning to Dynamically Coordinate Multi-Robot Teams in Graph Attention Networks

Learning Coordination Policies over Heterogeneous Graphs for Human-Robot Teams via Recurrent Neural Schedule Propagation

Multi-Agent Trajectory Prediction Based on Graph Neural Network

Heterogeneous multi-agent task allocation based on graph neural network ant colony optimization algorithms

Multi-Agent Reinforcement Learning for Job Shop Scheduling in Dynamic Environments

A Graph Attention Network Approach to Partitioned Scheduling in Real-Time Systems

End-to-end Multi-Target Flexible Job Shop Scheduling with Deep Reinforcement Learning

Multirobot collaborative task dynamic scheduling based on multiagent reinforcement learning with heuristic graph convolution considering robot service performance

Reinforcement Learning Based Online Scheduling of Multiple Workflows in Edge Environment

Team Assignment for Heterogeneous Multi-Robot Sensor Coverage through Graph Representation Learning

Mayfly Taylor Optimization-Based Graph Attention Network for Task Scheduling in Edge Computing

Flexible robotic cell scheduling with graph neural network based deep reinforcement learning

Flexible job shop scheduling via deep reinforcement learning with meta-path-based heterogeneous graph neural network

Distributed Allocation and Scheduling of Tasks with Cross-Schedule Dependencies for Heterogeneous Multi-Robot Teams

Heterogeneous Graph Reinforcement Learning for Dependency-aware Multi-task Allocation in Spatial Crowdsourcing

Heterogeneous Policy Networks for Composite Robot Team Communication and Coordination

Multi-Task Multi-Agent Reinforcement Learning for Real-Time Scheduling of a Dual-Resource Flexible Job Shop with Robots

Scalable Multi-Robot Task Allocation Using Graph Deep Reinforcement Learning with Graph Normalization

Dynamic Job-Shop Scheduling via Graph Attention Networks and Deep Reinforcement Learning

Heterogeneous Coalition Formation and Scheduling with Multi-Skilled Robots