Abstract:Dynamic scheduling of access to shared resources by autonomous systems is a challenging problem, characterized as being NP-hard. The complexity of this task leads to a combinatorial explosion of possibilities in highly dynamic systems where arriving requests must be continuously scheduled subject to strong safety and time constraints. An example of such a system is an unsignalized intersection, where automated vehicles' access to potential conflict zones must be dynamically scheduled. In this paper, we apply Neural Monte Carlo Tree Search (NMCTS) to the challenging task of scheduling platoons of vehicles crossing unsignalized intersections. Crucially, we introduce a transformation model that maps successive sequences of potentially conflicting road-space reservation requests from platoons of vehicles into a series of board-game-like problems and use NMCTS to search for solutions representing optimal road-space allocation schedules in the context of past allocations. To optimize search, we incorporate a prioritized re-sampling method with parallel NMCTS (PNMCTS) to improve the quality of training data. To optimize training, a curriculum learning strategy is used to train the agent to schedule progressively more complex boards culminating in overlapping boards that represent busy intersections. In a busy single four-way unsignalized intersection simulation, PNMCTS solved 95\% of unseen scenarios, reducing crossing time by 43\% in light and 52\% in heavy traffic versus first-in, first-out control. In a 3x3 multi-intersection network, the proposed method maintained free-flow in light traffic when all intersections are under control of PNMCTS and outperformed state-of-the-art RL-based traffic-light controllers in average travel time by 74.5\% and total throughput by 16\% in heavy traffic.

Cooperative Driving at Unsignalized Intersections Using Tree Search

Distributed Cooperative Driving Strategy for Connected Automated Vehicles at Unsignalized Intersections Based on Monte Carlo Method

Selection-sort-based cooperative driving strategy for CAVs at non-signalized intersections

Comparison of Cooperative Driving Strategies for CAVs at Signal-Free Intersections

A Real-Time Cooperative Driving Framework for Un-Signalized Intersection

Collision-Free Cooperative Motion Planning and Decision-Making for Connected and Automated Vehicles at Unsignalized Intersections

Real-time Cooperative Vehicle Coordination at Unsignalized Road Intersections

Virtual Platoon Based CAVs Cooperative Driving at Unsignalized Intersection

A Bi-Level Cooperative Driving Strategy Allowing Lane Changes

Cooperation of Multiple Connected Vehicles at Unsignalized Intersections: Distributed Observation, Optimization, and Control

Multi‐objective Optimal Cooperative Driving for Connected and Automated Vehicles at Non‐signalised Intersection

Cooperation Method of Connected and Automated Vehicles at Unsignalized Intersections: Lane Changing and Arrival Scheduling

Cooperative Schedule-Driven Intersection Control with Connected and Autonomous Vehicles

Cooperative Driving at Lane Closures

A Right-of-Way Based Strategy to Implement Safe and Efficient Driving at Non-Signalized Intersections for Automated Vehicles

A Value Based Parallel Update MCTS Method for Multi-Agent Cooperative Decision Making of Connected and Automated Vehicles

A Grouping-Based Cooperative Driving Strategy for CAVs Merging Problems.

Optimal Cooperative Driving at Signal-Free Intersections with Polynomial-Time Complexity

Applying Neural Monte Carlo Tree Search to Unsignalized Multi-intersection Scheduling for Autonomous Vehicles

Accelerating Cooperative Planning for Automated Vehicles with Learned Heuristics and Monte Carlo Tree Search

Collision-Free Autonomous Scheduling at Unsignalized Intersection Using Conflict Graph Tree Search