Natural language instructions for intuitive human interaction with robotic assistants in field construction work

Somin Park,Xi Wang,Carol C. Menassa,Vineet R. Kamat,Joyce Y. Chai
DOI: https://doi.org/10.1016/j.autcon.2024.105345
IF: 10.3
2024-03-03
Automation in Construction
Abstract:Human-Robot Collaboration (HRC) has shown promise of combining human workers' flexibility and robot assistants' physical abilities to jointly address the uncertainties inherent in construction work. In HRC, natural language-based interaction can enable human workers who are non-experts in robot programming to intuitively communicate with robot assistants. However, limited research has been conducted on this topic in construction. This paper proposes a framework to allow human workers to interact with construction robots based on natural language instructions for pick-and-place construction operations. The proposed method consists of three modules: Natural Language Understanding (NLU), Information Mapping (IM), and Robot Control (RC). A case study for drywall installation evaluates the proposed approach. Results indicate over 99% accuracy in NLU and IM, allowing a robot to perform tasks accurately for a given set of natural language instructions. It highlights the potential of using natural language-based interaction to replicate human-like communication in human-robot teams.
construction & building technology,engineering, civil
What problem does this paper attempt to address?