Abstract:Following the rule of human-centricity, Human Motion Digital Twin (HMDT) attempts to apply human motion data to ensure the development and well-being of human beings. Particularly, perception and estimation of human motion play fundamental roles in realizing HMDT. This work proposes an inertial motion capture system for human motion digital twin (InMoDT). The designed motion capture device is made up of a hub node and inertial measurement units attached to the human body. The proposed algorithm framework supported by sensor fusion and pose calibration algorithms, enables to acquire orientations of sensors and body segments. With the deployment of algorithms, InMoDT achieves an average root mean square error of 4.7 $^{\circ}$ in estimating orientations when compared with an optical motion capture system. Experimental results show a great correlation ( $92.5\%$ ) and agreement ( $97.8\%$ ) between InMoDT and the optical system. The abilities of InMoDT are spotted in terms of human-centric applications based on the integration of human, cyber system, and physical system, such as motion monitoring and estimation, and human-robot teleoperation. Note to Practitioners—This paper is motivated by the problem of inadequate attention on humans in Cyber-Physical System (CPS) while the roles of operators have a significant effect on industry. With the popular applications of digital twins in CPS, HMDT is expected to monitor, analyze, and assess motion data for facilitating the Human-Cyber-Physical System (HCPS) In this research work, the authors present a system for whole-body motion capture. The proposed system based on a wearable inertial sensor-based device provides a solution to construct HMDT. Moreover, a novel algorithm framework is employed, which consists of the sensor fusion algorithm and the kinematic constraints-based pose calibration algorithm. Experimental results demonstrate the system’s effectiveness in motion sensing accuracy, correlation, and agreement in comparison with the gold standard. The validated applications of the system lie in motion monitoring and estimation, and human-robot teleoperation, showing the potential for enhancing HMDT.

Mixed motion capture system and method

Human Motion Capture Using Wireless Inertial Sensors

Real-Time Human Motion Capture Based on Wearable Inertial Sensor Networks

A Human Motion Capture System Based on Inertial Sensing and a Complementary Filter

MAT: Motion-Aware Multi-Object Tracking

Physical Inertial Poser (PIP): Physics-aware Real-time Human Motion Tracking from Sparse Inertial Sensors

3D Deformation Capture Via a Configurable Self-Sensing IMU Sensor Network

A Scalable and Wearable Self-Sensing IMU Sensor Network for Personalized Human Motion and Deformation Capture

Combining Marker-based Mocap and RGB-D Camera for Acquiring High-fidelity Hand Motion Data.

Fusing Monocular Images and Sparse IMU Signals for Real-time Human Motion Capture

Ultra Inertial Poser: Scalable Motion Capture and Tracking from Sparse Inertial Sensors and Ultra-Wideband Ranging

A Robust Optical/inertial Data Fusion System for Motion Tracking of the Robot Manipulator

HybridCap: Inertia-Aid Monocular Capture of Challenging Human Motions

Three Axis Kinematics Study for Motion Capture Using Augmented Reality

Real-time Physics-based Motion Capture with Sparse Sensors

DeepMoCap: Deep Optical Motion Capture Using Multiple Depth Sensors and Retro-Reflectors

Accurate realtime full-body motion capture using a single depth camera

Articulated point pattern matching in optical motion capture systems

[Infrared radiative characteristic of Ho3+ in heavy metal tellurite glasses].

Toward Human Motion Digital Twin: A Motion Capture System for Human-Centric Applications

Markerless motion capture of interacting characters using multi-view image segmentation