Safe Autonomous Driving with Latent Dynamics and State-Wise Constraints

Changquan Wang,Yun Wang

DOI: https://doi.org/10.3390/s24103139

IF: 3.9

2024-05-16

Sensors

Abstract:Autonomous driving has the potential to revolutionize transportation, but developing safe and reliable systems remains a significant challenge. Reinforcement learning (RL) has emerged as a promising approach for learning optimal control policies in complex driving environments. However, existing RL-based methods often suffer from low sample efficiency and lack explicit safety constraints, leading to unsafe behaviors. In this paper, we propose a novel framework for safe reinforcement learning in autonomous driving that addresses these limitations. Our approach incorporates a latent dynamic model that learns the underlying dynamics of the environment from bird's-eye view images, enabling efficient learning and reducing the risk of safety violations by generating synthetic data. Furthermore, we introduce state-wise safety constraints through a barrier function, ensuring safety at each state by encoding constraints directly into the learning process. Experimental results in the CARLA simulator demonstrate that our framework significantly outperforms baseline methods in terms of both driving performance and safety. Our work advances the development of safe and efficient autonomous driving systems by leveraging the power of reinforcement learning with explicit safety considerations.

engineering, electrical & electronic,instruments & instrumentation,chemistry, analytical

What problem does this paper attempt to address?

The paper mainly discusses how to achieve safe driving in autonomous driving by combining potential dynamic models and state-level constraints to overcome the limitations of reinforcement learning (RL) methods in handling high-dimensional data and safety. Current RL methods are inefficient and lack explicit safety constraints when dealing with complex driving environments, which may lead to unsafe behaviors.

The paper proposes a new safe reinforcement learning framework, which involves learning the potential dynamic model of the environment from the bird's-eye view image to improve learning efficiency and reduce safety risks in generating synthetic data. In addition, state-level safety constraints are introduced through the use of barrier functions, ensuring that the constraints are directly encoded into the learning process at each state to ensure safety.

Experimental results show that the framework performs significantly better than baseline methods in terms of driving performance and safety in the CARLA simulator. The main contribution of the paper lies in harnessing the power of reinforcement learning and considering explicit safety factors, promoting the development of safe and efficient autonomous driving systems.