Abstract:This paper investigates high‐level decision making for autonomous overtaking under two‐way roads subject to oncoming vehicles, one of the most challenging manoeuvres in driving. To accomplish overtaking tasks safely and quickly, a high‐level decision‐making framework is proposed by integrating model predictive control (MPC) and switching control approaches. The performance of the proposed MPC framework is demonstrated via simulations of four driving scenarios, which show that it is able to handle multiple behaviours, including following a leading vehicle, slowdown, stop and overtaking. The key motivation of this paper lies in the development of a high‐level decision‐making framework for autonomous overtaking maneuvers on two‐lane country roads with dynamic oncoming traffic. To generate an optimal and safe decision sequence for such scenario, an innovative high‐level decision‐making framework that combines model predictive control (MPC) and switching control methodologies is introduced. Specifically, the autonomous vehicle is abstracted and modelled as a switched system. This abstraction allows vehicle to operate in different modes corresponding to different high‐level decisions. It establishes a crucial connection between high‐level decision‐making and low‐level behaviour of the autonomous vehicle. Furthermore, barrier functions and predictive models that account for the relationship between the autonomous vehicle and oncoming traffic are incorporated. This technique enables us to guarantee the satisfaction of constraints, while also assessing performance within a prediction horizon. By repeatedly solving the online constrained optimization problems, we not only generate an optimal decision sequence for overtaking safely and efficiently but also enhance the adaptability and robustness. This adaptability allows the system to respond effectively to potential changes and unexpected events. Finally, the performance of the proposed MPC framework is demonstrated via simulations of four driving scenarios, which shows that it can handle multiple behaviours.

Heuristic Reinforcement Learning Based Overtaking Decision for an Autonomous Vehicle

Heuristics-oriented overtaking decision making for autonomous vehicles using reinforcement learning

Reinforcement Learning Based Overtaking Decision-Making for Highway Autonomous Driving

A Fuzzy-Inference-based Reinforcement Learning Method of Overtaking Decision Making for Automated Vehicles

Decision-making for Overtaking in Specific Unmanned Driving Scenarios based on Deep Reinforcement Learning

Decision-making Strategy on Highway for Autonomous Vehicles using Deep Reinforcement Learning

A Deep Reinforcement Learning Based Approach for Autonomous Overtaking

Event‐triggered Optimisation of Overtaking Decision‐making Strategy for Autonomous Driving on Highway

Decision-Making for Oncoming Traffic Overtaking Scenario Using Double DQN

Graph Convolution Reinforcement Learning for Decision-Making in Highway Overtaking Scenario

Autonomous Overtaking for Intelligent Vehicles Considering Social Preference Based on Hierarchical Reinforcement Learning

Deep Reinforcement Learning Based Decision-Making Strategy of Autonomous Vehicle in Highway Uncertain Driving Environments

Gaussian Process Based Model Predictive Control for Overtaking in Autonomous Driving

Hierarchical Reinforcement Learning Combined with Motion Primitives for Automated Overtaking.

Game-Theoretic Decision-Making Method and Motion Planning for Autonomous Vehicles in Overtaking

Autonomous Overtaking Decision Making Of Driverless Bus Based On Deep Q-Learning Method

Reinforcement Learning for Cooperative Overtaking.

A Bootstrapped DQN-Based Decision-Making Method for Autonomous Driving Vehicles

High‐level decision‐making for autonomous overtaking: An MPC‐based switching control approach

A Reinforcement Learning Approach to Autonomous Decision Making of Intelligent Vehicles on Highways

Car-following Method Based on Inverse Reinforcement Learning for Autonomous Vehicle Decision-Making