Abstract:Autonomous driving is an advanced field that attracts significant attention and engages numerous researchers. However, relying solely on a single autonomous vehicle (AV) is insufficient to meet the demand of future transportation systems. This necessitates the application of connected and autonomous vehicles (CAVs), whose operation relies on multiagent decision-making technology. Currently, research primarily focuses on simple traffic scenarios. However, unsignalized intersections are frequently encountered in rural areas, characterized by high traffic volume, complex interactions, and significant risks. It is crucial to conduct research on the decision-making of CAVs at unsignalized intersections. To address these issues, the lane-changing decision-making of large-scale AVs at unsignalized intersections is studied in this paper. First, an action filter-based deep Q-network method named AF-DQN is proposed, which enables AVs to effectively filter out potentially hazardous lane-changing actions and execute safe actions. Additionally, a multi-objective reward function that considers multiple factors has been designed, including safety, task achievement, and compliance. Moreover, an exploratory training strategy is introduced to train the multi-agent deep reinforcement learning network model. The strategy facilitates agents to learn through exploration in simple scenarios before solving complex driving tasks in more complex scenarios. Finally, experiments are conducted to validate the effectiveness and superiority of the proposed method. Results show that exploratory training accelerates the model’s training speed and improves training effectiveness. Moreover, the AF-DQN method outperforms the baseline method in terms of safety, efficiency, and adherence to traffic rules.

Deep Reinforcement Learning Enabled Decision-Making for Autonomous Driving at Intersections

Decision-Making Models for Autonomous Vehicles at Unsignalized Intersections Based on Deep Reinforcement Learning.

Autonomous Vehicle Decision-Making at Unsignalized Intersection via Deep Reinforcement Learning

Decision-making at Unsignalized Intersection for Autonomous Vehicles: Left-turn Maneuver with Deep Reinforcement Learning

Decision-Making for Autonomous Vehicles in Random Task Scenarios at Unsignalized Intersection Using Deep Reinforcement Learning

Decision-making Strategy on Highway for Autonomous Vehicles using Deep Reinforcement Learning

Deep Reinforcement Learning Based Game-Theoretic Decision-Making for Autonomous Vehicles

Decision Making of Autonomous Vehicles in Lane Change Scenarios: Deep Reinforcement Learning Approaches with Risk Awareness

Safe and Adaptive Decision Algorithm of Automated Vehicle for Unsignalized Intersection Driving

Reinforcement-Learning-Based Decision and Control for Autonomous Vehicle at Two-Way Single-Lane Unsignalized Intersection

Autonomous Driving at Unsignalized Intersections: A Review of Decision-Making Challenges and Reinforcement Learning-Based Solutions

Autonomous Vehicles' Decision-Making Behavior in Complex Driving Environments Using Deep Reinforcement Learning

A Rear Anti-Collision Decision-Making Methodology Based on Deep Reinforcement Learning for Autonomous Commercial Vehicles

A Comprehensive Driving Decision-Making Methodology Based on Deep Reinforcement Learning for Automated Commercial Vehicles

Deep Reinforcement Learning Based Decision-Making Strategy of Autonomous Vehicle in Highway Uncertain Driving Environments

Deep Q-Network Based Decision Making for Autonomous Driving

AF-DQN: A Large-Scale Decision-Making Method at Unsignalized Intersections with Safe Action Filter and Efficient Exploratory Training Strategy

Deep Reinforcement Learning for Autonomous Vehicle Intersection Navigation

Modeling Adaptive Platoon and Reservation Based Autonomous Intersection Control: A Deep Reinforcement Learning Approach

Enhancing High-Speed Cruising Performance of Autonomous Vehicles through Integrated Deep Reinforcement Learning Framework