Abstract:Recent years have witnessed the rapid development of the Cooperative Vehicle Infrastructure System (CVIS), where road infrastructures such as traffic lights (TL) and autonomous vehicles (AVs) can share information among each other and work collaboratively to provide safer and more comfortable transportation experience to human beings. While many efforts have been made to develop efficient and sustainable CVIS solutions, existing approaches on urban intersections heavily rely on domain knowledge and physical assumptions, preventing them from being practically applied. To this end, this paper proposes NavTL, a learning-based framework to jointly control traffic signal plans and autonomous vehicle rerouting in mixed traffic scenarios where human-driven vehicles and AVs co-exist. The objective is to improve travel efficiency and reduce total travel time by minimizing congestion at the intersections while guiding AVs to avoid the temporally congested roads. Specifically, we design a graph-enhanced multi-agent decentralized bi-directional hierarchical reinforcement learning framework by regarding TLs as manager agents and AVs as worker agents. At lower temporal resolution timesteps, each manager sets a goal for the workers within its controlled region. Simultaneously, managers learn to take the signal actions based on the observation from the environment as well as an intention information extracted from its workers. At higher temporal resolution timesteps, each worker makes rerouting decisions along its way to the destination based on its observation from the environment, an intention-enhanced manager state representation, and a goal from its present manager. Finally, extensive experiments on one synthetic and two real-world network-level datasets demonstrate the effectiveness of our proposed framework in terms of improving travel efficiency.

State Dropout-Based Curriculum Reinforcement Learning for Self-Driving at Unsignalized Intersections

Reward-Driven Automated Curriculum Learning for Interaction-Aware Self-Driving at Unsignalized Intersections

Navigating Occluded Intersections with Autonomous Vehicles using Deep Reinforcement Learning

Self-Learned Autonomous Driving at Unsignalized Intersections: A Hierarchical Reinforced Learning Approach for Feasible Decision-Making

A Multi-Task Reinforcement Learning Approach for Navigating Unsignalized Intersections

Deep reinforcement learning for autonomous driving in uncontrolled intersections of Indian roads

Autonomous Vehicle Decision-Making at Unsignalized Intersection via Deep Reinforcement Learning

Courteous Behavior of Automated Vehicles at Unsignalized Intersections Via Reinforcement Learning

Autonomous Driving at Unsignalized Intersections: A Review of Decision-Making Challenges and Reinforcement Learning-Based Solutions

Curriculum Reinforcement Learning for Autonomous Planning in Unprotected Left Turn Scenarios

Roadside Units Assisted Localized Automated Vehicle Maneuvering: An Offline Reinforcement Learning Approach

Cooperative Trajectory Planning at Unsignalized Intersections Using Deep Reinforcement Learning

Safe Trajectory Planning Using Reinforcement Learning for Self Driving

Reinforcement Learning-Based Autonomous Driving at Intersections in CARLA Simulator

Decision-making at Unsignalized Intersection for Autonomous Vehicles: Left-turn Maneuver with Deep Reinforcement Learning

Decision-Making Models for Autonomous Vehicles at Unsignalized Intersections Based on Deep Reinforcement Learning.

Object Detection with Deep Neural Networks for Reinforcement Learning in the Task of Autonomous Vehicles Path Planning at the Intersection

Safe Deep Q-Network for Autonomous Vehicles at Unsignalized Intersection

Learning to Navigate Intersections with Unsupervised Driver Trait Inference

Hierarchical Reinforcement Learning for Dynamic Autonomous Vehicle Navigation at Intelligent Intersections