From Cognition to Precognition: A Future-Aware Framework for Social Navigation

Zeying Gong,Tianshuai Hu,Ronghe Qiu,Junwei Liang

2024-09-20

Abstract:To navigate safely and efficiently in crowded spaces, robots should not only perceive the current state of the environment but also anticipate future human movements. In this paper, we propose a reinforcement learning architecture, namely Falcon, to tackle socially-aware navigation by explicitly predicting human trajectories and penalizing actions that block future human paths. To facilitate realistic evaluation, we introduce a novel SocialNav benchmark containing two new datasets, Social-HM3D and Social-MP3D. This benchmark offers large-scale photo-realistic indoor scenes populated with a reasonable amount of human agents based on scene area size, incorporating natural human movements and trajectory patterns. We conduct a detailed experimental analysis with the state-of-the-art learning-based method and two classic rule-based path-planning algorithms on the new benchmark. The results demonstrate the importance of future prediction and our method achieves the best task success rate of 55% while maintaining about 90% personal space compliance. We will release our code and datasets. Videos of demonstrations can be viewed at <a class="link-external link-https" href="https://zeying-gong.github.io/projects/falcon/" rel="external noopener nofollow">this https URL</a> .

Robotics,Artificial Intelligence

What problem does this paper attempt to address?

The paper aims to address the problem of safe and efficient navigation for robots in crowded environments. Specifically, the authors propose a new framework called Falcon, which tackles the Socially-Aware Navigation (SocialNav) task by explicitly predicting human trajectories and penalizing behaviors that may obstruct future pedestrian paths. To validate the effectiveness of this approach, the authors introduce a new SocialNav benchmark, which includes two new datasets—Social-HM3D and Social-MP3D. These datasets feature large-scale realistic indoor scenes and reasonably placed human agents based on the scene area, encompassing natural human movement patterns.

Additionally, the paper compares Falcon with several other methods, including classical rule-based path planning algorithms and reinforcement learning-based approaches. The results show that Falcon not only excels in terms of goal achievement rate and adherence to social norms but also demonstrates good generalization ability in unseen environments. Experimental analysis indicates that Falcon outperforms other algorithms in various typical social navigation scenarios, showcasing its advantages in future-aware methods.