Abstract:This research focuses on developing a robot digital twin (DT) and the communication methods to connect it with the corresponding physical robot in collaborative human–robot construction work. Robots are being increasingly deployed on construction sites to assist human workers with physically demanding work tasks. Robot simulations in a process-level DT can be used to extend design models, such as building information modeling, to the construction phase for real-time monitoring of robot motion planning and control. Robots can be enabled to plan work tasks and execute them in the DT simulations. Once simulated tasks and trajectories are approved by human workers, commands can be sent to the physical robots to perform the tasks. However, a system to bridge a virtual DT and a physical robot and allow for such communication to occur is a capability that has not been readily available thus far, primarily due to the complexity involved in physical robot operations. This paper discusses the development of a system to bridge robot simulations and physical robots in construction and digital fabrication. The Gazebo robot simulator is used for DT, and the robot operating system is leveraged as the primary framework for bi-directional communication with the physical robots. The virtual robots in Gazebo receive planned trajectories from motion planners and then send the commands to the physical robots for execution. Two different robot control modes, i.e., joint angle control mode and Cartesian path control mode, are developed to accommodate various construction strategies. The system is implemented in a digital fabrication case study with a full-scale KUKA KR120 six-degrees-of-freedom robotic arm mounted on a track system. We evaluated the system by comparing the data transmission time, joint angles, and end-effector pose between the virtual and physical robot using several planned trajectories and calculated the average and maximum mean square errors. The results showed that the proposed real-time process-level robot DT system can plan the robot trajectory inside the virtual environment and execute it in the physical environment with high accuracy and real-time performance, offering the opportunity for further development and deployment of the collaborative human–robot work paradigm on real construction sites.

Digital twin for mobile robot modeling and simulation

Digital Twin System for Home Service Robot Based on Motion Simulation

HumRoboSim: an Autonomous Humanoid Robot Simulation System

Design and Application of a Digital Twin System for Mobile Robot Ranging Sensors

Digital Twin for FANUC Robots: Industrial Robot Programming and Simulation Using Virtual Reality

Construction Method of a Digital-Twin Simulation System for SCARA Robots Based on Modular Communication

Digital Twin of Industrial Robots Over the Cloud: Framework, Design and Analysis

Development of a Simple and Novel Digital Twin Framework for Industrial Robots in Intelligent robotics manufacturing

A digital twin-based machining motion simulation and visualization monitoring system for milling robot

An Application of a Digital Twin to Robotic System Design for an Unstructured Environment

Mobile Robot Control and Autonomy Through Collaborative Simulation Twin

Embedding Digital Twin Technology in Robotics

A Digital Twinning Platform for Integrated Sensing, Communications and Robotics

Bidirectional Linkage Robot Digital Twin System Based on ROS

Rapid Development of a Mobile Robot Simulation Environment

Genetic Algorithm-Based Trajectory Optimization for Digital Twin Robots

Real-time state synchronization between physical construction robots and process-level digital twins

Digital Twin: Concept of Hybrid Programming for Industrial Robots — Use Case

An Integrated Mobile Augmented Reality Digital Twin Monitoring System

Application of Virtual Reality in Developing the Digital Twin for an Integrated Robot Learning System

Robopheus: A Virtual-Physical Interactive Mobile Robotic Testbed