Abstract:Advances in Mechanical Engineering, Volume 14, Issue 12, December 2022. Obstacle avoidance path planning in a dynamic circumstance is one of the fundamental problems of autonomous vehicles, counting optional maneuvers: emergency braking and active steering. This paper proposes emergency obstacle avoidance planning based on deep reinforcement learning (DRL), considering safety and comfort. Firstly, the vehicle emergency braking and lane change processes are analyzed in detail. A graded hazard index is defined to indicate the degree of the potential risk of the current vehicle movement. The longitudinal distance and lateral waypoint models are established, including the comfort deceleration and stability coefficient considerations. Simultaneously, a fuzzy PID controller is installed to track to satisfy the stability and feasibility of the path. Then, this paper proposes a DRL process to determine the obstacle avoidance plan. Mainly, multi-reward functions are designed for different collisions, corresponding penalties for longitudinal rear-end collisions, and lane-changing side collisions based on the safety distance, comfort reward, and safety reward. Apply a special DRL method-DQN to release the planning program. The difference is that the long and short-term memory (LSTM) layer is utilized to solve incomplete observations and improve the efficiency and stability of the algorithm in a dynamic environment. Once the policy is practiced, the vehicle can automatically perform the best obstacle avoidance maneuver in an emergency, improving driving safety. Finally, this paper builds a simulated environment in CARLA and is trained to evaluate the effectiveness of the proposed algorithm. The collision rate, safety distance difference, and total reward index indicate that the collision avoidance path is generated safely, and the lateral acceleration and longitudinal velocity satisfy the comfort requirements. Besides, the method proposed in this paper is compared with traditional DRL, which proves the beneficial performance in safety and efficiency.

Survival-Oriented Reinforcement Learning Model: an Effcient and Robust Deep Reinforcement Learning Algorithm for Autonomous Driving Problem.

A Safe and Efficient Self-evolving Algorithm for Decision-making and Control of Autonomous Driving Systems

Towards Robust Decision-Making for Autonomous Highway Driving Based on Safe Reinforcement Learning

Safe-State Enhancement Method for Autonomous Driving Via Direct Hierarchical Reinforcement Learning.

Enhancing System-Level Safety in Mixed-Autonomy Platoon via Safe Reinforcement Learning

Obstacle avoidance planning of autonomous vehicles using deep reinforcement learning

Emergency Collision Avoidance Decision-making for Autonomous Vehicles: A Model-based Reinforcement Learning Approach

An Improved Deep Reinforcement Learning Algorithm for Path Planning in Unmanned Driving

Robustness and Performance of Deep Reinforcement Learning.

Long and Short-Term Constraints Driven Safe Reinforcement Learning for Autonomous Driving

Safe Autonomous Driving with Latent Dynamics and State-Wise Constraints

Towards Robust Decision-Making for Autonomous Driving on Highway

Autonomous Motion Decision-making based on Deep Reinforcement Learning for Autonomous Driving

Comprehensive Training and Evaluation on Deep Reinforcement Learning for Automated Driving in Various Simulated Driving Maneuvers

Improved Deep Reinforcement Learning for Car-Following Decision-Making

Multi-objective Longitudinal Decision-making for Autonomous Electric Vehicle: A Entropy-constrained Reinforcement Learning Approach.

An Intelligent Car-Following Model Based on Multi-Step Deep Reinforcement Learning

Offline Reinforcement Learning for Autonomous Driving with Safety and Exploration Enhancement

Safe Model-based Off-policy Reinforcement Learning for Eco-Driving in Connected and Automated Hybrid Electric Vehicles

Uncertainty Sequence Modeling Approach for Safe and Effective Autonomous Driving

Pay Attention to How You Drive: Safe and Adaptive Model-Based Reinforcement Learning for Off-Road Driving