BIM-based Safe and Trustworthy Robot Pathfinding using Scalable MHA* Algorithms and Natural Language Processing

Mani Amani,Reza Akhavian

2024-11-23

Abstract:Construction robots have gained significant traction in recent years in research and development. However, the application of industrial robots has unique challenges. Dynamic environments, domain-specific tasks, and complex localization and mapping are significant obstacles in their development. In construction job sites, moving objects and complex machinery can make pathfinding a difficult task due to the possibility of object collisions. Existing methods such as simultaneous localization and mapping are viable solutions to this problem, however, due to the precision and data quality required by the sensors and the processing of the information, they can be very computationally expensive. We propose using spatial and semantic information in building information modeling (BIM) to develop domain-specific pathfinding strategies. In this work, we integrate a multi-heuristic A* (MHA*) algorithm using APFs from the BIM spatial information and process textual information from the BIM using large language models (LLMs) to adjust the algorithm for dynamic object avoidance. We show increased robot object proximity by 80% while maintaining similar path lengths.

Robotics

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to provide safe and reliable path planning for robots in the dynamic environment of construction sites. Specifically, the challenges mentioned in the paper include:

1. **Dynamic environment**: Objects and mechanical equipment on construction sites are often in motion, which makes path planning complex and prone to collisions.
2. **Task requirements in specific fields**: Construction has special requirements for path planning, such as avoiding obstacles and adjusting paths in real - time.
3. **Complex positioning and mapping**: On construction sites, the data quality of sensors and the precision of information processing are highly required, resulting in increased computing costs.

To solve these problems, the author proposes a method that combines the multi - heuristic A* algorithm (MHA*) based on the Building Information Model (BIM) with Natural Language Processing (NLP). This method utilizes the spatial and semantic information provided by BIM to develop domain - specific path - planning strategies and processes text information through large - scale language models (LLMs) to adjust the algorithm, so as to better deal with the obstacle - avoidance problem of dynamic objects.

In addition, the paper also shows how this method can improve the safety of robots by 80% when approaching objects while maintaining a similar path length. This improvement is crucial for ensuring that robots work efficiently and safely in complex and changeable construction environments.