Abstract:Advances in Mechanical Engineering, Volume 14, Issue 12, December 2022. Obstacle avoidance path planning in a dynamic circumstance is one of the fundamental problems of autonomous vehicles, counting optional maneuvers: emergency braking and active steering. This paper proposes emergency obstacle avoidance planning based on deep reinforcement learning (DRL), considering safety and comfort. Firstly, the vehicle emergency braking and lane change processes are analyzed in detail. A graded hazard index is defined to indicate the degree of the potential risk of the current vehicle movement. The longitudinal distance and lateral waypoint models are established, including the comfort deceleration and stability coefficient considerations. Simultaneously, a fuzzy PID controller is installed to track to satisfy the stability and feasibility of the path. Then, this paper proposes a DRL process to determine the obstacle avoidance plan. Mainly, multi-reward functions are designed for different collisions, corresponding penalties for longitudinal rear-end collisions, and lane-changing side collisions based on the safety distance, comfort reward, and safety reward. Apply a special DRL method-DQN to release the planning program. The difference is that the long and short-term memory (LSTM) layer is utilized to solve incomplete observations and improve the efficiency and stability of the algorithm in a dynamic environment. Once the policy is practiced, the vehicle can automatically perform the best obstacle avoidance maneuver in an emergency, improving driving safety. Finally, this paper builds a simulated environment in CARLA and is trained to evaluate the effectiveness of the proposed algorithm. The collision rate, safety distance difference, and total reward index indicate that the collision avoidance path is generated safely, and the lateral acceleration and longitudinal velocity satisfy the comfort requirements. Besides, the method proposed in this paper is compared with traditional DRL, which proves the beneficial performance in safety and efficiency.

Motion Planning of Vehicle Obstacle Avoidance by Quantum Reinforcement Learning

Optimization-based Motion Planning for Autonomous Parking Considering Dynamic Obstacle: A Hierarchical Framework

Learning Hierarchical Behavior and Motion Planning for Autonomous Driving.

Obstacle avoidance planning of autonomous vehicles using deep reinforcement learning

Optimal reinforcement learning and probabilistic-risk-based path planning and following of autonomous vehicles with obstacle avoidance

Enhancing System-Level Safety in Mixed-Autonomy Platoon via Safe Reinforcement Learning

A Safe Hierarchical Planning Framework for Complex Driving Scenarios based on Reinforcement Learning

Trajectory Planning for Autonomous Vehicles Using Hierarchical Reinforcement Learning

Action and Trajectory Planning for Urban Autonomous Driving with Hierarchical Reinforcement Learning

Conditional DQN-Based Motion Planning With Fuzzy Logic for Autonomous Driving

Motion Planning for Autonomous Driving with Extended Constrained Iterative LQR

Behavior and Interaction-aware Motion Planning for Autonomous Driving Vehicles based on Hierarchical Intention and Motion Prediction

Hierarchical Motion Planning and Tracking for Autonomous Vehicles Using Global Heuristic Based Potential Field and Reinforcement Learning Based Predictive Control

Motion Planning at Intersections with Event-driven Recurrent Q-Learning

Deep Reinforcement Learning Based Trajectory Planning Under Uncertain Constraints

Spatiotemporal Trajectory Planning for Autonomous Vehicle based on Reachable Set and Iterative LQR

AI drive: quantum-computational DRL framework for EHV navigational efficiency and security augmentation

Learning-based Near-optimal Motion Planning for Intelligent Vehicles with Uncertain Dynamics

Behavior Planning at Urban Intersections through Hierarchical Reinforcement Learning

Real Time Motion Planning Using Constrained Iterative Linear Quadratic Regulator for On-Road Self-Driving

A Risk-Averse Preview-Based $Q$-Learning Algorithm: Application to Highway Driving of Autonomous Vehicles