Abstract:Autonomous driving is an advanced field that attracts significant attention and engages numerous researchers. However, relying solely on a single autonomous vehicle (AV) is insufficient to meet the demand of future transportation systems. This necessitates the application of connected and autonomous vehicles (CAVs), whose operation relies on multiagent decision-making technology. Currently, research primarily focuses on simple traffic scenarios. However, unsignalized intersections are frequently encountered in rural areas, characterized by high traffic volume, complex interactions, and significant risks. It is crucial to conduct research on the decision-making of CAVs at unsignalized intersections. To address these issues, the lane-changing decision-making of large-scale AVs at unsignalized intersections is studied in this paper. First, an action filter-based deep Q-network method named AF-DQN is proposed, which enables AVs to effectively filter out potentially hazardous lane-changing actions and execute safe actions. Additionally, a multi-objective reward function that considers multiple factors has been designed, including safety, task achievement, and compliance. Moreover, an exploratory training strategy is introduced to train the multi-agent deep reinforcement learning network model. The strategy facilitates agents to learn through exploration in simple scenarios before solving complex driving tasks in more complex scenarios. Finally, experiments are conducted to validate the effectiveness and superiority of the proposed method. Results show that exploratory training accelerates the model’s training speed and improves training effectiveness. Moreover, the AF-DQN method outperforms the baseline method in terms of safety, efficiency, and adherence to traffic rules.

Autonomous Overtaking Decision Making Of Driverless Bus Based On Deep Q-Learning Method

A Deep Learning Method for Lane Changing Situation Assessment and Decision Making.

Learning an Efficient and Safe Policy for Highway Driving Using Supervised Learning and Reinforcement Learning.

A Deep Reinforcement Learning Based Approach for Autonomous Overtaking

Decision-making Strategy on Highway for Autonomous Vehicles using Deep Reinforcement Learning

Dueling Deep Q Network for Highway Decision Making in Autonomous Vehicles: A Case Study

Deep Q-Network Based Decision Making for Autonomous Driving

DQ-GAT: Towards Safe and Efficient Autonomous Driving With Deep Q-Learning and Graph Attention Networks

A Fuzzy-Inference-based Reinforcement Learning Method of Overtaking Decision Making for Automated Vehicles

Graph Convolution Reinforcement Learning for Decision-Making in Highway Overtaking Scenario

Multi-vehicle Platoon Overtaking Using NoisyNet Multi-Agent Deep Q-Learning Network

Research on Autonomous Driving Decision-making Strategies based Deep Reinforcement Learning

End-to-End Autonomous Driving Through Dueling Double Deep Q-Network

Heuristics-oriented overtaking decision making for autonomous vehicles using reinforcement learning

Multi-objective optimization for autonomous driving strategy based on Deep Q Network

Research on decision-making of lane-changing of automated vehicles in highway confluence area based on deep reinforcement learning

Deep Reinforcement Learning Based Decision-Making Strategy of Autonomous Vehicle in Highway Uncertain Driving Environments

AF-DQN: A Large-Scale Decision-Making Method at Unsignalized Intersections with Safe Action Filter and Efficient Exploratory Training Strategy

Control method of autonomous mini-car based on deep Q-network

Modeling takeover time for non-driving related tasks using hybrid deep neural networks in conditionally automated vehicles

Adaptive Traffic Signal Control with Deep Recurrent Q-learning