Abstract:Dynamic scheduling of access to shared resources by autonomous systems is a challenging problem, characterized as being NP-hard. The complexity of this task leads to a combinatorial explosion of possibilities in highly dynamic systems where arriving requests must be continuously scheduled subject to strong safety and time constraints. An example of such a system is an unsignalized intersection, where automated vehicles' access to potential conflict zones must be dynamically scheduled. In this paper, we apply Neural Monte Carlo Tree Search (NMCTS) to the challenging task of scheduling platoons of vehicles crossing unsignalized intersections. Crucially, we introduce a transformation model that maps successive sequences of potentially conflicting road-space reservation requests from platoons of vehicles into a series of board-game-like problems and use NMCTS to search for solutions representing optimal road-space allocation schedules in the context of past allocations. To optimize search, we incorporate a prioritized re-sampling method with parallel NMCTS (PNMCTS) to improve the quality of training data. To optimize training, a curriculum learning strategy is used to train the agent to schedule progressively more complex boards culminating in overlapping boards that represent busy intersections. In a busy single four-way unsignalized intersection simulation, PNMCTS solved 95\% of unseen scenarios, reducing crossing time by 43\% in light and 52\% in heavy traffic versus first-in, first-out control. In a 3x3 multi-intersection network, the proposed method maintained free-flow in light traffic when all intersections are under control of PNMCTS and outperformed state-of-the-art RL-based traffic-light controllers in average travel time by 74.5\% and total throughput by 16\% in heavy traffic.

Solving Disjunctive Temporal Networks with Uncertainty under Restricted Time-Based Controllability Using Tree Search and Graph Neural Networks

Differentiable Tree Search Network

Planning spatial networks with Monte Carlo tree search

Controlling Graph Dynamics with Reinforcement Learning and Graph Neural Networks

Solving the non-submodular network collapse problems via Decision Transformer

Research on Knowledge Graph Completion Model Combining Temporal Convolutional Network and Monte Carlo Tree Search

Conditional Uncertainty Quantification for Tensorized Topological Neural Networks

Learning Topological Representations with Bidirectional Graph Attention Network for Solving Job Shop Scheduling Problem

TTT: A Temporal Refinement Heuristic for Tenuously Tractable Discrete Time Reachability Problems

Dynamic Inference on Graphs using Structured Transition Models

Reinforcement Learning Based Monte Carlo Tree Search for Temporal Path Discovery

Combining Neural Networks and Tree Search for Task and Motion Planning in Challenging Environments

CDRGN-SDE: Cross-Dimensional Recurrent Graph Network with neural Stochastic Differential Equation for temporal knowledge graph embedding

Decision Transformer for Enhancing Neural Local Search on the Job Shop Scheduling Problem

Temporal Graph Networks for Deep Learning on Dynamic Graphs

TREE-G: Decision Trees Contesting Graph Neural Networks

Applying Neural Monte Carlo Tree Search to Unsignalized Multi-intersection Scheduling for Autonomous Vehicles

TeCoRe: Temporal Conflict Resolution in Knowledge Graphs

Stochastic Maintenance Schedules of Active Distribution Networks Based on Monte-Carlo Tree Search

De Bruijn goes Neural: Causality-Aware Graph Neural Networks for Time Series Data on Dynamic Graphs

Search to Pass Messages for Temporal Knowledge Graph Completion