Abstract:Recent years have witnessed the rapid development of the Cooperative Vehicle Infrastructure System (CVIS), where road infrastructures such as traffic lights (TL) and autonomous vehicles (AVs) can share information among each other and work collaboratively to provide safer and more comfortable transportation experience to human beings. While many efforts have been made to develop efficient and sustainable CVIS solutions, existing approaches on urban intersections heavily rely on domain knowledge and physical assumptions, preventing them from being practically applied. To this end, this paper proposes NavTL, a learning-based framework to jointly control traffic signal plans and autonomous vehicle rerouting in mixed traffic scenarios where human-driven vehicles and AVs co-exist. The objective is to improve travel efficiency and reduce total travel time by minimizing congestion at the intersections while guiding AVs to avoid the temporally congested roads. Specifically, we design a graph-enhanced multi-agent decentralized bi-directional hierarchical reinforcement learning framework by regarding TLs as manager agents and AVs as worker agents. At lower temporal resolution timesteps, each manager sets a goal for the workers within its controlled region. Simultaneously, managers learn to take the signal actions based on the observation from the environment as well as an intention information extracted from its workers. At higher temporal resolution timesteps, each worker makes rerouting decisions along its way to the destination based on its observation from the environment, an intention-enhanced manager state representation, and a goal from its present manager. Finally, extensive experiments on one synthetic and two real-world network-level datasets demonstrate the effectiveness of our proposed framework in terms of improving travel efficiency.

A Multi-Task Reinforcement Learning Approach for Navigating Unsignalized Intersections

Multi-task Safe Reinforcement Learning for Navigating Intersections in Dense Traffic

Multi-Agent Reinforcement Learning-Based Autonomous Intersection Management Protocol with Attention Mechanism

Multi-Task Conditional Imitation Learning for Autonomous Navigation at Crowded Intersections

Learning Autonomous Control Policy for Intersection Navigation with Pedestrian Interaction

Hierarchical Reinforcement Learning for Dynamic Autonomous Vehicle Navigation at Intelligent Intersections

Learning to Navigate Intersections with Unsupervised Driver Trait Inference

A Multi-Objective Optimal Control Method for Navigating Connected and Automated Vehicles at Signalized Intersections Based on Reinforcement Learning

Navigating Occluded Intersections with Autonomous Vehicles using Deep Reinforcement Learning

Autonomous navigation at unsignalized intersections: A coupled reinforcement learning and model predictive control approach

Reward-Driven Automated Curriculum Learning for Interaction-Aware Self-Driving at Unsignalized Intersections

Multiagent reinforcement learning for autonomous driving in traffic zones with unsignalized intersections

Learning to Socially Navigate in Pedestrian-rich Environments with Interaction Capacity

Efficient Multi-agent Cooperative Navigation in Unknown Environments with Interlaced Deep Reinforcement Learning.

Modeling Adaptive Platoon and Reservation Based Autonomous Intersection Control: A Deep Reinforcement Learning Approach

Decision-making at Unsignalized Intersection for Autonomous Vehicles: Left-turn Maneuver with Deep Reinforcement Learning

Cooperative Trajectory Planning at Unsignalized Intersections Using Deep Reinforcement Learning

Multi-Intersection Management for Connected Autonomous Vehicles by Reinforcement Learning

Roadside Units Assisted Localized Automated Vehicle Maneuvering: An Offline Reinforcement Learning Approach

Safe Efficient Policy Optimization Algorithm for Unsignalized Intersection Navigation

Courteous Behavior of Automated Vehicles at Unsignalized Intersections Via Reinforcement Learning