Abstract:This research focuses on developing a robot digital twin (DT) and the communication methods to connect it with the corresponding physical robot in collaborative human–robot construction work. Robots are being increasingly deployed on construction sites to assist human workers with physically demanding work tasks. Robot simulations in a process-level DT can be used to extend design models, such as building information modeling, to the construction phase for real-time monitoring of robot motion planning and control. Robots can be enabled to plan work tasks and execute them in the DT simulations. Once simulated tasks and trajectories are approved by human workers, commands can be sent to the physical robots to perform the tasks. However, a system to bridge a virtual DT and a physical robot and allow for such communication to occur is a capability that has not been readily available thus far, primarily due to the complexity involved in physical robot operations. This paper discusses the development of a system to bridge robot simulations and physical robots in construction and digital fabrication. The Gazebo robot simulator is used for DT, and the robot operating system is leveraged as the primary framework for bi-directional communication with the physical robots. The virtual robots in Gazebo receive planned trajectories from motion planners and then send the commands to the physical robots for execution. Two different robot control modes, i.e., joint angle control mode and Cartesian path control mode, are developed to accommodate various construction strategies. The system is implemented in a digital fabrication case study with a full-scale KUKA KR120 six-degrees-of-freedom robotic arm mounted on a track system. We evaluated the system by comparing the data transmission time, joint angles, and end-effector pose between the virtual and physical robot using several planned trajectories and calculated the average and maximum mean square errors. The results showed that the proposed real-time process-level robot DT system can plan the robot trajectory inside the virtual environment and execute it in the physical environment with high accuracy and real-time performance, offering the opportunity for further development and deployment of the collaborative human–robot work paradigm on real construction sites.

Sensor Acquisition and Allocation for Real-Time Monitoring of Articulated Construction Equipment in Digital Twins

A Framework for Digital Twin of Civil Infrastructure— Challenges & Opportunities

Automated Generation of FE Model for Digital Twin of Concrete Structures from Segmented 3D Point Cloud

Exploring Data for Construction Digital Twins: Building Health and Safety and Progress Monitoring Twins Using the Unreal Gaming Engine

Multisensory and BIM-Integrated Digital Twin to Improve Urban Excavation Safety

Building a 3D Digital Twin for Geotechnical Monitoring at San Xavier Mine

A digital twin–driven monitoring framework for dual-robot collaborative manipulation

An Integrated Mobile Augmented Reality Digital Twin Monitoring System

Digital twin for production estimation, scheduling and real-time monitoring in offsite construction

Real-time state synchronization between physical construction robots and process-level digital twins

Earthwork digital twin for teleoperation of an automated bulldozer in edge dumping

Real-Time and Remote Construction Progress Monitoring with a Quadruped Robot Using Augmented Reality

Digital Twins for Real-Time Scenario Analysis during Well Construction Operations

Automatic creation of personalised virtual construction safety training using digital twins

Mitigating Measurement Inaccuracies in Digital Twins of Construction Machinery through Multi-Objective Optimization

Design of Twin Builder-Based Digital Twin Online Monitoring System for Crane Girders

Interactive and Immersive Process-Level Digital Twin for Collaborative Human–Robot Construction Work

A digital twin framework for civil engineering structures

A Reconstruction Methodology of Dynamic Construction Site Activities in 3D Digital Twin Models Based on Camera Information

Augmented reality and digital twin system for interaction with construction machinery