Abstract:Urban intersections are prone to delays and inefficiencies due to static precedence rules and occlusions limiting the view on prioritized traffic. Existing approaches to improve traffic flow, widely known as automatic intersection management systems, are mostly based on non-learning reservation schemes or optimization algorithms. Machine learning-based techniques show promising results in planning for a single ego vehicle. This work proposes to leverage machine learning algorithms to optimize traffic flow at urban intersections by jointly planning for multiple vehicles. Learning-based behavior planning poses several challenges, demanding for a suited input and output representation as well as large amounts of ground-truth data. We address the former issue by using a flexible graph-based input representation accompanied by a graph neural network. This allows to efficiently encode the scene and inherently provide individual outputs for all involved vehicles. To learn a sensible policy, without relying on the imitation of expert demonstrations, the cooperative planning task is considered as a reinforcement learning problem. We train and evaluate the proposed method in an open-source simulation environment for decision making in automated driving. Compared to a first-in-first-out scheme and traffic governed by static priority rules, the learned planner shows a significant gain in flow rate, while reducing the number of induced stops. In addition to synthetic simulations, the approach is also evaluated based on real-world traffic data taken from the publicly available inD dataset.

Cooperative Motion Planning for Non-Holonomic Agents with Value Iteration Networks

Rollout-Based Interactive Motion Planning for Automated Vehicles *

Motion Planning for Multi-robot Cooperation Based on Cooperative Co-evolutionary Roadmap Method

Value Iteration Networks with Double Estimator for Planetary Rover Path Planning

Capability Iteration Network for Robot Path Planning

Linear Differential Games for Cooperative Behavior Planning of Autonomous Vehicles Using Mixed-Integer Programming

It Takes Two: Learning to Plan for Human-Robot Cooperative Carrying

Asynchronous Value Iteration Network

Highway Value Iteration Networks

Decentralized Motion Planning for Multi-Robot Navigation using Deep Reinforcement Learning

Dynamically Constrained Motion Planning Networks for Non-Holonomic Robots

Balancing Computation Speed and Quality: A Decentralized Motion Planning Method for Cooperative Lane Changes of Connected and Automated Vehicles.

Mixed‐Integer Motion Planning for Nonholonomic Robots Under Visible Light Communication Constraints

Combining Neural Networks and Tree Search for Task and Motion Planning in Challenging Environments

A neural network-based exploratory learning and motor planning system for co-robots

Learning Reward Models for Cooperative Trajectory Planning with Inverse Reinforcement Learning and Monte Carlo Tree Search

Fast Multi-Robot Motion Planning via Imitation Learning of Mixed-Integer Programs

Cooperative Behavior Planning for Automated Driving Using Graph Neural Networks

Scaling Value Iteration Networks to 5000 Layers for Extreme Long-Term Planning

A Mixed-Integer Approach for Motion Planning of Nonholonomic Robots under Visible Light Communication Constraints

Coordinated Motion Planning of Dual-arm Space Robot with Deep Reinforcement Learning