Abstract:Advances in Mechanical Engineering, Volume 14, Issue 12, December 2022. Obstacle avoidance path planning in a dynamic circumstance is one of the fundamental problems of autonomous vehicles, counting optional maneuvers: emergency braking and active steering. This paper proposes emergency obstacle avoidance planning based on deep reinforcement learning (DRL), considering safety and comfort. Firstly, the vehicle emergency braking and lane change processes are analyzed in detail. A graded hazard index is defined to indicate the degree of the potential risk of the current vehicle movement. The longitudinal distance and lateral waypoint models are established, including the comfort deceleration and stability coefficient considerations. Simultaneously, a fuzzy PID controller is installed to track to satisfy the stability and feasibility of the path. Then, this paper proposes a DRL process to determine the obstacle avoidance plan. Mainly, multi-reward functions are designed for different collisions, corresponding penalties for longitudinal rear-end collisions, and lane-changing side collisions based on the safety distance, comfort reward, and safety reward. Apply a special DRL method-DQN to release the planning program. The difference is that the long and short-term memory (LSTM) layer is utilized to solve incomplete observations and improve the efficiency and stability of the algorithm in a dynamic environment. Once the policy is practiced, the vehicle can automatically perform the best obstacle avoidance maneuver in an emergency, improving driving safety. Finally, this paper builds a simulated environment in CARLA and is trained to evaluate the effectiveness of the proposed algorithm. The collision rate, safety distance difference, and total reward index indicate that the collision avoidance path is generated safely, and the lateral acceleration and longitudinal velocity satisfy the comfort requirements. Besides, the method proposed in this paper is compared with traditional DRL, which proves the beneficial performance in safety and efficiency.

Dynamic Obstacle Avoidance and Path Planning through Reinforcement Learning

RL and ANN Based Modular Path Planning Controller for Resource-Constrained Robots in the Indoor Complex Dynamic Environment

Real-Time Path Planning for Mobile Robots

An Efficient Approach for Obstacle Avoidance and Navigation in Robots

Obstacle avoidance planning of autonomous vehicles using deep reinforcement learning

Dynamic Obstacle Avoidance Technique for Mobile Robot Navigation Using Deep Reinforcement Learning

Reinforcement learning-based dynamic obstacle avoidance and integration of path planning

A Review on Path Planning and Obstacle Avoidance Algorithms for Autonomous Mobile Robots

Addressing unpredictable movements of dynamic obstacles with deep reinforcement learning to ensure safe navigation for omni-wheeled mobile robot

Tactile Aware Dynamic Obstacle Avoidance in Crowded Environment with Deep Reinforcement Learning

A deep reinforcement learning based method for real-time path planning and dynamic obstacle avoidance

A Review of Deep Reinforcement Learning Algorithms for Mobile Robot Path Planning

Optimal reinforcement learning and probabilistic-risk-based path planning and following of autonomous vehicles with obstacle avoidance

Dynamic Path Planning for Mobile Robots with Deep Reinforcement Learning

Path Planning in Dynamic Environments through Trajectory Prediction and Reinforcement Learning

Trajectory Planning of Robotic Manipulator in Dynamic Environment Exploiting DRL

A Review of Mobile Robot Path Planning Based on Deep Reinforcement Learning Algorithm

Motion Planning for Mobile Robots—Focusing on Deep Reinforcement Learning: A Systematic Review

Deep Reinforcement Learning for Mobile Robot Path Planning

Path Planning Techniques for Real-Time Multi-Robot Systems: A Systematic Review

Design and Experimental Validation of Deep Reinforcement Learning-Based Fast Trajectory Planning and Control for Mobile Robot in Unknown Environment