Sequential Neural Barriers for Scalable Dynamic Obstacle Avoidance

Hongzhan Yu,Chiaki Hirayama,Chenning Yu,Sylvia Herbert,Sicun Gao
2023-07-06
Abstract:There are two major challenges for scaling up robot navigation around dynamic obstacles: the complex interaction dynamics of the obstacles can be hard to model analytically, and the complexity of planning and control grows exponentially in the number of obstacles. Data-driven and learning-based methods are thus particularly valuable in this context. However, data-driven methods are sensitive to distribution drift, making it hard to train and generalize learned models across different obstacle densities. We propose a novel method for compositional learning of Sequential Neural Control Barrier models (SNCBFs) to achieve scalability. Our approach exploits an important observation: the spatial interaction patterns of multiple dynamic obstacles can be decomposed and predicted through temporal sequences of states for each obstacle. Through decomposition, we can generalize control policies trained only with a small number of obstacles, to environments where the obstacle density can be 100x higher. We demonstrate the benefits of the proposed methods in improving dynamic collision avoidance in comparison with existing methods including potential fields, end-to-end reinforcement learning, and model-predictive control. We also perform hardware experiments and show the practical effectiveness of the approach in the supplementary video.
Robotics,Artificial Intelligence
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the challenge of achieving large - scale robot navigation in dynamic obstacle environments. Specifically, there are two main challenges: 1. **Difficult to model the complex interaction dynamics of dynamic obstacles**: The behavior patterns of dynamic obstacles (such as pedestrians) are complex and difficult to model by analytical methods. This makes traditional methods based on known dynamics (such as the artificial potential field method, the dynamic window method, and model - predictive control) ineffective when dealing with a large number of dynamic obstacles. 2. **The complexity of planning and control increases exponentially with the number of obstacles**: As the number of dynamic obstacles in the environment increases, the complexity of planning and control rises sharply, causing traditional methods to be difficult to scale to high - density obstacle environments. To address these challenges, the authors propose a new method - **Sequential Neural Control Barrier Functions (SN - CBFs)**. The core idea of this method is to decompose the spatial interaction patterns of dynamic obstacles and use time - series data to predict the future states of each obstacle. In this way, the trained control strategy can be generalized from an environment with a small number of obstacles to an environment with a much higher density of obstacles, thereby achieving scalable dynamic obstacle avoidance. ### Main contributions 1. **Verification of the feasibility of sequential decomposition**: The authors first verified that the collective behavior of dynamic obstacles can be approximately decomposed by the sequence patterns of each obstacle. This decomposition method can significantly reduce the complexity of the model and improve its generalization ability under different obstacle densities. 2. **Design and training of the SN - CBF model**: The authors designed an SN - CBF model architecture based on LSTM and Multi - Layer Perceptron (MLP) and proposed a two - stage training method: - **Initial training**: Use random trajectory samples to initially mark safe and unsafe areas. - **Boundary refinement**: On the basis of the initial training, further optimize the invariance properties of the model by sampling near the safety boundary. 3. **Experimental verification**: The authors verified the effectiveness of the proposed method through simulation and hardware experiments. The experimental results show that the SN - CBF method has significantly better obstacle - avoidance performance in high - density obstacle environments than existing methods, such as the artificial potential field method, end - to - end reinforcement learning, and model - predictive control. ### Key technologies - **Sequential decomposition**: Analyze the historical trajectories of each obstacle to infer its future state, thereby avoiding directly modeling complex collective interaction dynamics. - **SN - CBF model**: Combine sequential data and local interaction patterns to generate a value landscape for guiding the robot's safe control actions in the current state. - **Two - stage training**: Gradually optimize the performance and robustness of the model through initial training and boundary refinement. ### Conclusion This paper proposes a new method that achieves efficient obstacle avoidance in high - density dynamic obstacle environments through Sequential Neural Control Barrier Functions (SN - CBFs). This method not only improves the generalization ability of the model but also solves the limitations of traditional methods in complex environments.