Abstract:An efficient and reliable multi-agent decision-making system is highly demanded for the safe and efficient operation of connected autonomous vehicles in intelligent transportation systems. Current researches mainly focus on the Deep Reinforcement Learning (DRL) methods. However, utilizing DRL methods in interactive traffic scenarios is hard to represent the mutual effects between different vehicles and model the dynamic traffic environments due to the lack of interactive information in the representation of the environments, which results in low accuracy of cooperative decisions generation. To tackle these difficulties, this research proposes a framework to enable different Graph Reinforcement Learning (GRL) methods for decision-making, and compares their performance in interactive driving scenarios. GRL methods combinate the Graph Neural Network (GNN) and DRL to achieve the better decisions generation in interactive scenarios of autonomous vehicles, where the features of interactive scenarios are extracted by the GNN, and cooperative behaviors are generated by DRL framework. Several GRL approaches are summarized and implemented in the proposed framework. To evaluate the performance of the proposed GRL methods, an interactive driving scenarios on highway with two ramps is constructed, and simulated experiment in the SUMO platform is carried out to evaluate the performance of different GRL approaches. Finally, results are analyzed in multiple perspectives and dimensions to compare the characteristic of different GRL approaches in intelligent transportation scenarios. Results show that the implementation of GNN can well represents the interaction between vehicles, and the combination of GNN and DRL is able to improve the performance of the generation of lane-change behaviors. The source code of our work can be found at <a class="link-external link-https" href="https://github.com/Jacklinkk/TorchGRL" rel="external noopener nofollow">this https URL</a>.

DRL-GAT-SA: Deep reinforcement learning for autonomous driving planning based on graph attention networks and simplex architecture

DQ-GAT: Towards Safe and Efficient Autonomous Driving With Deep Q-Learning and Graph Attention Networks

Edge-enhanced Graph Attention Network for driving decision-making of autonomous vehicles via Deep Reinforcement Learning

Generalized Single-Vehicle-Based Graph Reinforcement Learning for Decision-Making in Autonomous Driving

Attention-based Highway Safety Planner for Autonomous Driving Via Deep Reinforcement Learning

Robot Navigation among External Autonomous Agents Through Deep Reinforcement Learning Using Graph Attention Network

Graph Reinforcement Learning Application to Co-operative Decision-Making in Mixed Autonomy Traffic: Framework, Survey, and Challenges

SIF-STGDAN: A Social Interaction Force Spatial-Temporal Graph Dynamic Attention Network for Decision-Making of Connected and Autonomous Vehicles

Graph Convolution Reinforcement Learning for Decision-Making in Highway Overtaking Scenario

Safe-State Enhancement Method for Autonomous Driving Via Direct Hierarchical Reinforcement Learning.

Motion Planner with Fixed-Horizon Constrained Reinforcement Learning for Complex Autonomous Driving Scenarios

Towards Autonomous Driving Decision by Combining Self-attention and Deep Reinforcement Learning.

Deep Reinforcement Learning for Autonomous Driving with an Auxiliary Actor Discriminator

Autonomous Highway Driving using Deep Reinforcement Learning

Graph Convolution-Based Deep Reinforcement Learning for Multi-Agent Decision-Making in Mixed Traffic Environments

Decision-making in Autonomous Driving by Reinforcement Learning Combined with Planning & Control

Graph Reinforcement Learning-Based Decision-Making Technology for Connected and Autonomous Vehicles: Framework, Review, and Future Trends

Enhancing Autonomous Lane-Changing Safety: Deep Reinforcement Learning Via Pre-Exploration in Parallel Imaginary Environments

DRNet: A Decision-Making Method for Autonomous Lane Changingwith Deep Reinforcement Learning

Deep, Consistent Behavioral Decision Making with Planning Features for Autonomous Vehicles

Adept Guide and Guard Reinforcement Learning for Safe Driving in Lane-Keeping Scenarios