Abstract:This research focuses on developing a robot digital twin (DT) and the communication methods to connect it with the corresponding physical robot in collaborative human–robot construction work. Robots are being increasingly deployed on construction sites to assist human workers with physically demanding work tasks. Robot simulations in a process-level DT can be used to extend design models, such as building information modeling, to the construction phase for real-time monitoring of robot motion planning and control. Robots can be enabled to plan work tasks and execute them in the DT simulations. Once simulated tasks and trajectories are approved by human workers, commands can be sent to the physical robots to perform the tasks. However, a system to bridge a virtual DT and a physical robot and allow for such communication to occur is a capability that has not been readily available thus far, primarily due to the complexity involved in physical robot operations. This paper discusses the development of a system to bridge robot simulations and physical robots in construction and digital fabrication. The Gazebo robot simulator is used for DT, and the robot operating system is leveraged as the primary framework for bi-directional communication with the physical robots. The virtual robots in Gazebo receive planned trajectories from motion planners and then send the commands to the physical robots for execution. Two different robot control modes, i.e., joint angle control mode and Cartesian path control mode, are developed to accommodate various construction strategies. The system is implemented in a digital fabrication case study with a full-scale KUKA KR120 six-degrees-of-freedom robotic arm mounted on a track system. We evaluated the system by comparing the data transmission time, joint angles, and end-effector pose between the virtual and physical robot using several planned trajectories and calculated the average and maximum mean square errors. The results showed that the proposed real-time process-level robot DT system can plan the robot trajectory inside the virtual environment and execute it in the physical environment with high accuracy and real-time performance, offering the opportunity for further development and deployment of the collaborative human–robot work paradigm on real construction sites.

Robotic Tele-operation Performance Analysis via Digital Twin Simulations

Digital Twin in Safety-Critical Robotics Applications: Opportunities and Challenges

Digital Twin of Industrial Robots Over the Cloud: Framework, Design and Analysis

Mobile Robot Control and Autonomy Through Collaborative Simulation Twin

An Application of a Digital Twin to Robotic System Design for an Unstructured Environment

Embedding Digital Twin Technology in Robotics

A Digital Twin for Telesurgery under Intermittent Communication

Analog Twin Framework for Human and AI Supervisory Control and Teleoperation of Robots

Digital Twin for FANUC Robots: Industrial Robot Programming and Simulation Using Virtual Reality

Implementing Autonomous Control in the Digital-Twins-Based Internet of Robotic Things for Remote Patient Monitoring

TELESIM: A Modular and Plug-and-Play Framework for Robotic Arm Teleoperation using a Digital Twin

Digital Twin: Concept of Hybrid Programming for Industrial Robots — Use Case

Digital Twins Below the Surface: Enhancing Underwater Teleoperation

Web-based Experiment on Human Performance in Dual-Robot Teleoperation

Digital twin for mobile robot modeling and simulation

Simulation and Digital Twin: Modern Technology and Approach

Optimizing Collaborative Robotics since Pre-Deployment via Cyber-Physical Systems' Digital Twins

Digital twins for collaborative robots: A case study in human-robot interaction

Real-time state synchronization between physical construction robots and process-level digital twins

Digital-Twin-Based Real-Time Optimization for A Fractional Order Controller for Industrial Robots

Towards enabling reliable immersive teleoperation through Digital Twin: A UAV command and control use case