Abstract:An efficient and reliable multi-agent decision-making system is highly demanded for the safe and efficient operation of connected autonomous vehicles in intelligent transportation systems. Current researches mainly focus on the Deep Reinforcement Learning (DRL) methods. However, utilizing DRL methods in interactive traffic scenarios is hard to represent the mutual effects between different vehicles and model the dynamic traffic environments due to the lack of interactive information in the representation of the environments, which results in low accuracy of cooperative decisions generation. To tackle these difficulties, this research proposes a framework to enable different Graph Reinforcement Learning (GRL) methods for decision-making, and compares their performance in interactive driving scenarios. GRL methods combinate the Graph Neural Network (GNN) and DRL to achieve the better decisions generation in interactive scenarios of autonomous vehicles, where the features of interactive scenarios are extracted by the GNN, and cooperative behaviors are generated by DRL framework. Several GRL approaches are summarized and implemented in the proposed framework. To evaluate the performance of the proposed GRL methods, an interactive driving scenarios on highway with two ramps is constructed, and simulated experiment in the SUMO platform is carried out to evaluate the performance of different GRL approaches. Finally, results are analyzed in multiple perspectives and dimensions to compare the characteristic of different GRL approaches in intelligent transportation scenarios. Results show that the implementation of GNN can well represents the interaction between vehicles, and the combination of GNN and DRL is able to improve the performance of the generation of lane-change behaviors. The source code of our work can be found at <a class="link-external link-https" href="https://github.com/Jacklinkk/TorchGRL" rel="external noopener nofollow">this https URL</a>.

Finding path and cycle counting formulae in graphs with Deep Reinforcement Learning

Learning to Cooperate: Application of Deep Reinforcement Learning for Online AGV Path Finding.

G-PCGRL: Procedural Graph Data Generation via Reinforcement Learning

GRL-PS: Graph Embedding-Based DRL Approach for Adaptive Path Selection

Graph Convolution-Based Deep Reinforcement Learning for Multi-Agent Decision-Making in Interactive Traffic Scenarios.

Graph learning-based generation of abstractions for reinforcement learning

Explore with Dynamic Map: Graph Structured Reinforcement Learning

Graph Reinforcement Learning Application to Co-operative Decision-Making in Mixed Autonomy Traffic: Framework, Survey, and Challenges

GRL: Knowledge graph completion with GAN-based reinforcement learning

Graph Convolution-Based Deep Reinforcement Learning for Multi-Agent Decision-Making in Mixed Traffic Environments

RLgraph: Modular Computation Graphs for Deep Reinforcement Learning

PCGRL+: Scaling, Control and Generalization in Reinforcement Learning Level Generators

Graph Reinforcement Learning for Power Grids: A Comprehensive Survey

Reinforcement Learning Based Monte Carlo Tree Search for Temporal Path Discovery

Research on Knowledge Graph Completion Model Combining Temporal Convolutional Network and Monte Carlo Tree Search

GROM: A Generalized Routing Optimization Method with Graph Neural Network and Deep Reinforcement Learning

RoboGrammar

Reinforced Molecular Optimization with Neighborhood-Controlled Grammars

CGTR: Leveraging Contrastive Learning and Graph Transformer for Deep Reinforcement Learning Based Robust Routing

Reinforcement Learning Discovers Efficient Decentralized Graph Path Search Strategies

Graph Convolution with Topology Refinement for Automatic Reinforcement Learning