Abstract:Following the rule of human-centricity, Human Motion Digital Twin (HMDT) attempts to apply human motion data to ensure the development and well-being of human beings. Particularly, perception and estimation of human motion play fundamental roles in realizing HMDT. This work proposes an inertial motion capture system for human motion digital twin (InMoDT). The designed motion capture device is made up of a hub node and inertial measurement units attached to the human body. The proposed algorithm framework supported by sensor fusion and pose calibration algorithms, enables to acquire orientations of sensors and body segments. With the deployment of algorithms, InMoDT achieves an average root mean square error of 4.7 $^{\circ}$ in estimating orientations when compared with an optical motion capture system. Experimental results show a great correlation ( $92.5\%$ ) and agreement ( $97.8\%$ ) between InMoDT and the optical system. The abilities of InMoDT are spotted in terms of human-centric applications based on the integration of human, cyber system, and physical system, such as motion monitoring and estimation, and human-robot teleoperation. Note to Practitioners—This paper is motivated by the problem of inadequate attention on humans in Cyber-Physical System (CPS) while the roles of operators have a significant effect on industry. With the popular applications of digital twins in CPS, HMDT is expected to monitor, analyze, and assess motion data for facilitating the Human-Cyber-Physical System (HCPS) In this research work, the authors present a system for whole-body motion capture. The proposed system based on a wearable inertial sensor-based device provides a solution to construct HMDT. Moreover, a novel algorithm framework is employed, which consists of the sensor fusion algorithm and the kinematic constraints-based pose calibration algorithm. Experimental results demonstrate the system’s effectiveness in motion sensing accuracy, correlation, and agreement in comparison with the gold standard. The validated applications of the system lie in motion monitoring and estimation, and human-robot teleoperation, showing the potential for enhancing HMDT.

A wireless human pose detection method based on digital twin and inertial sensor

Mpose: Environment- and Subject-Agnostic 3D Skeleton Posture Reconstruction Leveraging a Single Mmwave Device

Construction of Human Digital Twin Model Based on Multimodal Data and Its Application in Locomotion Mode Identification

UWB-Radar-Based 3D Human Pose Estimation Using Micro-Range/Micro-Doppler Images

Toward Human Motion Digital Twin: A Motion Capture System for Human-Centric Applications

Motion Imitation of a Humanoid Robot Via Pose Estimation

Mmskeleton: 3D Human Skeleton Estimation Using Millimeter Wave Radar Sparse Point Clouds

A Portable System for ToF Camera Based Human Body Detection and Pose Estimation

Human Motion Capture Using Wireless Inertial Sensors

Towards 3D Human Pose Construction Using Wifi.

Human-centric Application in Cyber-Physical System: an Inertial-based Motion Capture and Recognition System

Person-in-WiFi 3D: End-to-End Multi-Person 3D Pose Estimation with Wi-Fi

Real-Time Human Motion Capture Based on Wearable Inertial Sensor Networks

Sensor network oriented human motion capture via wearable intelligent system

3D Human Pose Estimation for Free-form Activity Using WiFi Signals

DensePose From WiFi

Seeing the Unseen: Wifi-based 2D Human Pose Estimation via an Evolving Attentive Spatial-Frequency Network

3D Human Pose Estimation for Free-from and Moving Activities Using WiFi

Device-Free Stationary Human Detection with WiFi in Through-the-Wall Scenarios

WiSH: WiFi-based Real-Time Human Detection

Compressed Representation for 3D Human Pose Estimation using WiFi signal