Abstract:Digitals twins, used to represent dynamic environments, require accurate tracking of human movement to enhance their real-world application. This paper contributes to the field by systematically evaluating and comparing pre-existing tracking methods to identify strengths, weaknesses and practical applications within digital twin frameworks. The purpose of this study is to assess the efficacy of existing human movement tracking techniques for digital twins in real world environments, with the goal of improving spatial analysis and interaction within these virtual modes. We compare three approaches using indoor-mounted lidar sensors: (1) a frame-by-frame method deep learning model with convolutional neural networks (CNNs), (2) custom algorithms developed using OpenCV, and (3) the off-the-shelf lidar perception software package Percept version 1.6.3. Of these, the deep learning method performed best (F1 = 0.88), followed by Percept (F1 = 0.61), and finally the custom algorithms using OpenCV (F1 = 0.58). Each method had particular strengths and weaknesses, with OpenCV-based approaches that use frame comparison vulnerable to signal instability that is manifested as "flickering" in the dataset. Subsequent analysis of the spatial distribution of error revealed that both the custom algorithms and Percept took longer to acquire an identification, resulting in increased error near doorways. Percept software excelled in scenarios involving stationary individuals. These findings highlight the importance of selecting appropriate tracking methods for specific use. Future work will focus on model optimization, alternative data logging techniques, and innovative approaches to mitigate computational challenges, paving the way for more sophisticated and accessible spatial analysis tools. Integrating complementary sensor types and strategies, such as radar, audio levels, indoor positioning systems (IPSs), and wi-fi data, could further improve detection accuracy and validation while maintaining privacy.

Digital Twin Tracking Dataset (DTTD): A New RGB+Depth 3D Dataset for Longer-Range Object Tracking Applications

DepthTrack : Unveiling the Power of RGBD Tracking

ARKitTrack: A New Diverse Dataset for Tracking Using Mobile RGB-D Data

Robust 6DoF Pose Estimation Against Depth Noise and a Comprehensive Evaluation on a Mobile Dataset

DELTAR: Depth Estimation from a Light-Weight ToF Sensor and RGB Image

RGB-D to CAD Retrieval with ObjectNN Dataset

RGB-T Object Tracking:Benchmark and Baseline

RGBD Objects in the Wild: Scaling Real-World 3D Object Learning from RGB-D Videos

RGBD Object Tracking: An In-depth Review

Tiny Object Tracking: A Large-scale Dataset and A Baseline

GDTM: An Indoor Geospatial Tracking Dataset with Distributed Multimodal Sensors

The H3D Dataset for Full-Surround 3D Multi-Object Detection and Tracking in Crowded Urban Scenes

Enhancing Digital Twins with Human Movement Data: A Comparative Study of Lidar-Based Tracking Methods

Effective 3D Object Detection Based on Detector and Tracker.

OmniPose6D: Towards Short-Term Object Pose Tracking in Dynamic Scenes from Monocular RGB

MMPTRACK: Large-scale Densely Annotated Multi-camera Multiple People Tracking Benchmark

NTU RGB+D 120: A Large-Scale Benchmark for 3D Human Activity Understanding

TransCG: A Large-Scale Real-World Dataset for Transparent Object Depth Completion and a Grasping Baseline

KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3D

A Tracking-By-Detection Based 3D Multiple Object Tracking for Autonomous Driving

Robust Performance-driven 3D Face Tracking in Long Range Depth Scenes.