Abstract:Following the rule of human-centricity, Human Motion Digital Twin (HMDT) attempts to apply human motion data to ensure the development and well-being of human beings. Particularly, perception and estimation of human motion play fundamental roles in realizing HMDT. This work proposes an inertial motion capture system for human motion digital twin (InMoDT). The designed motion capture device is made up of a hub node and inertial measurement units attached to the human body. The proposed algorithm framework supported by sensor fusion and pose calibration algorithms, enables to acquire orientations of sensors and body segments. With the deployment of algorithms, InMoDT achieves an average root mean square error of 4.7 $^{\circ}$ in estimating orientations when compared with an optical motion capture system. Experimental results show a great correlation ( $92.5\%$ ) and agreement ( $97.8\%$ ) between InMoDT and the optical system. The abilities of InMoDT are spotted in terms of human-centric applications based on the integration of human, cyber system, and physical system, such as motion monitoring and estimation, and human-robot teleoperation. Note to Practitioners—This paper is motivated by the problem of inadequate attention on humans in Cyber-Physical System (CPS) while the roles of operators have a significant effect on industry. With the popular applications of digital twins in CPS, HMDT is expected to monitor, analyze, and assess motion data for facilitating the Human-Cyber-Physical System (HCPS) In this research work, the authors present a system for whole-body motion capture. The proposed system based on a wearable inertial sensor-based device provides a solution to construct HMDT. Moreover, a novel algorithm framework is employed, which consists of the sensor fusion algorithm and the kinematic constraints-based pose calibration algorithm. Experimental results demonstrate the system’s effectiveness in motion sensing accuracy, correlation, and agreement in comparison with the gold standard. The validated applications of the system lie in motion monitoring and estimation, and human-robot teleoperation, showing the potential for enhancing HMDT.

Research of a Kinect-Based Dhm to Capture and Simulate the Human Behavior

The Design and Implementation of Natural Human-Robot Interaction System Based on Kinect Sensor

Design of a cerebral palsy rehabilitation training system based on Kinect motion interactive mode

Design of Kinect-based Human Robot Interaction Systems for a RoboCup Middle Size League Soccer Robot

Using a Kinect Sensor to Acquire Biological Motion: Toolbox and Evaluation.

Inertial Motion Capture-Driven Digital Human for Ergonomic Validation: A Case Study of Core Drilling

Human Factor Studies on Gestural Interaction: Past, Present, and Future

Human-centric Application in Cyber-Physical System: an Inertial-based Motion Capture and Recognition System

A Universal Self-Adaption Workspace Mapping Method for Human–Robot Interaction Using Kinect Sensor Data

A framework of motion capture system based human behaviours simulation for ergonomic analysis

Construction of Human Digital Twin Model Based on Multimodal Data and Its Application in Locomotion Mode Identification

Using Subject-Specific Three-Dimensional (3D) Anthropometry Data in Digital Human Modelling: Case Study in Hand Motion Simulation

Measuring Accurate Body Parameters Of Dressed Humans With Large-Scale Motion Using A Kinect Sensor

A Low-Cost Inertial Measurement Unit Motion Capture System for Operation Posture Collection and Recognition

Motion Capture Benchmark of Real Industrial Tasks and Traditional Crafts for Human Movement Analysis

Toward Human Motion Digital Twin: A Motion Capture System for Human-Centric Applications

On using the Microsoft Kinect$^{\rm TM}$ sensors in the analysis of human motion

Reconstructing 3D Human Models with a Kinect

A Kinect-Based Motion Capture Method for Assessment of Lower Extremity Exoskeleton

Integrating digital human modeling into virtual environment for ergonomic oriented design

Real-Time System for Human Activity Analysis