Abstract:Deep reinforcement learning (DRL) provides a promising approach for the implementation of autonomous driving. By utilizing a trained DRL model as the longitudinal controller, the automated vehicle (AV) can generate optimal action outputs based on the state within a shorter time compared to traditional model predictive control (MPC) methods. However, the non-interpretability of neural networks poses a potential risk for real-world vehicle operation. This paper focuses on applying the Twin Delayed Deep Deterministic Policy Gradient (TD3), a state-of-the-art (SOTA) DRL algorithm, to train the longitudinal control model for AVs. We confirm the risks associated with the TD3-based longitudinal control model by assessing its violation of the rational driving constraint (RDC), which represents the basic conditions for normal driving behaviors. To mitigate these risks, we propose a novel model that integrates the TD3-based model with the intelligent driver model (IDM) using a new indicator called velocity response time (VRT). This indicator identifies risky outputs of the TD3-based model and calculates the combined weights of both the IDM and TD3-based models. This combination allows us to reduce risks associated with the non-interpretability of the neural network while also capturing the effect of engine time lag. Numerical simulations are conducted to evaluate the performance of the proposed combined model. The results demonstrate that the proposed combined model outperforms the TD3-based model, IDM, and another SOTA approach in terms of disturbance mitigation, safety improvement, and suppression of traffic oscillation. Additionally, the combined model exhibits greater computational efficiency than MPC, making it well-suited for real-time control of AVs.

A Shared Control Approach for Autonomous Vehicles via Driver Behaviors Learning

A Confidence-based Allocation Approach for USV Trajectory Tracking Via Human-Robot Co-Driving

Indirect Shared Control of Highly Automated Vehicles for Cooperative Driving between Driver and Automation

Adaptive authority allocation-based driver-automation shared control for autonomous vehicles

An intelligent human-machine interaction-based longitudinal control strategy for autonomous vehicles

Shared Control for Intelligent Vehicle Based on Handling Inverse Dynamics and Driving Intention

Personalized driving behavior oriented autonomous vehicle control for typical traffic situations

Indirect Shared Control for Cooperative Driving Between Driver and Automation in Steer-by-Wire Vehicles

A Human-Machine Shared Control Framework Considering Time-Varying Driver Characteristics

Driver-automation Indirect Shared Control of Highly Automated Vehicles with Intention-Aware Authority Transition

Improving safety in mixed traffic: A learning-based model predictive control for autonomous and human-driven vehicle platooning

Learning-Based Modeling of Human-Autonomous Vehicle Interaction for Improved Safety in Mixed-Vehicle Platooning Control

Intelligent-Assist Algorithm for Remote Shared-Control Driving Based on Game Theory

Model Predictive Control with Gaussian-Process-Supported Dynamical Constraints for Autonomous Vehicles

Shared control for human–machine co-driving vehicles based on constraint-following approach

Enhancing Safety in Mixed Traffic: Learning-Based Modeling and Efficient Control of Autonomous and Human-Driven Vehicles

A Fuzzy Logic Shared Steering Control Approach For Semi-Autonomous Vehicle

Interaction-aware Model Predictive Control for Autonomous Driving

Longitudinal control of automated vehicles: A novel approach by integrating deep reinforcement learning with intelligent driver model

Human–Machine Shared Lateral Control Strategy for Intelligent Vehicles Based on Human Driver Risk Perception Reliability