Real-time state synchronization between physical construction robots and process-level digital twins

Ci-Jyun Liang,Wes McGee,Carol C. Menassa,Vineet R. Kamat

DOI: https://doi.org/10.1007/s41693-022-00068-1

2022-03-22

Construction Robotics

Abstract:This research focuses on developing a robot digital twin (DT) and the communication methods to connect it with the corresponding physical robot in collaborative human–robot construction work. Robots are being increasingly deployed on construction sites to assist human workers with physically demanding work tasks. Robot simulations in a process-level DT can be used to extend design models, such as building information modeling, to the construction phase for real-time monitoring of robot motion planning and control. Robots can be enabled to plan work tasks and execute them in the DT simulations. Once simulated tasks and trajectories are approved by human workers, commands can be sent to the physical robots to perform the tasks. However, a system to bridge a virtual DT and a physical robot and allow for such communication to occur is a capability that has not been readily available thus far, primarily due to the complexity involved in physical robot operations. This paper discusses the development of a system to bridge robot simulations and physical robots in construction and digital fabrication. The Gazebo robot simulator is used for DT, and the robot operating system is leveraged as the primary framework for bi-directional communication with the physical robots. The virtual robots in Gazebo receive planned trajectories from motion planners and then send the commands to the physical robots for execution. Two different robot control modes, i.e., joint angle control mode and Cartesian path control mode, are developed to accommodate various construction strategies. The system is implemented in a digital fabrication case study with a full-scale KUKA KR120 six-degrees-of-freedom robotic arm mounted on a track system. We evaluated the system by comparing the data transmission time, joint angles, and end-effector pose between the virtual and physical robot using several planned trajectories and calculated the average and maximum mean square errors. The results showed that the proposed real-time process-level robot DT system can plan the robot trajectory inside the virtual environment and execute it in the physical environment with high accuracy and real-time performance, offering the opportunity for further development and deployment of the collaborative human–robot work paradigm on real construction sites.