Abstract:Multiple construction worker tracking is an active research area critical to the planning of the job site. Challenges in multiple construction worker tracking include miss detection and mismatch due to occlusion and identity switches. To the best knowledge of the authors, the mismatch is not reported in the literature of construction for image based single camera multiple worker tracking. As a result, the mismatch should be taken into account through a representative performance index such as the Multi-Object Tracking Accuracy (MOTA). This work aims to improve the performance of the current multiple worker tracking through an approach composed of three stages: detection, matching and re-matching. In the detection stage, the deep learning detector, Mask R-CNN, is utilized. In the matching stage, we attempt to track workers between consecutive image frames through a gradient based method with feature based comparison. Several cost means and matching methods have been experimented for model selection. Trajectories of tracking objects are derived in this stage. The best cost measurements and matching methods are recommended. Trajectories of tracking objects could be interrupted because of miss detection or mismatch. We call those broken trajectories, without matched detections, orphans. In the re-matching stage, we attempt to recover unmatched detections in the current frame with previous orphans based on extracted features. A competitive MOTA of 56.7% was obtained from the proposed approach over MOTA of 55.9% from the state-of-the-art Detect-And-Track model on a human tracking benchmark dataset. On construction job sites, we have tested the approach with 4 testing videos, resulting in a total MOTA of 81.8%, average MOTA per video of 79.0% and standard deviation of 13.0%, while the maximum and minimum MOTAs are 96.0% and 69.0%, respectively. As a result, the proposed work could potentially provide better multiple worker tracking on the construction job site. Additionally, to have a better representation of the tracking errors, this work suggests to utilize the MOTA for multiple construction worker tracking.

Vision-Based Real-Time Posture Tracking for Multiple Construction Workers

Posture Tracking Meets Fitness Coaching: A Two-Phase Optimization Approach with Wearable Devices

Automated Kinect-based posture evaluation method for work-related musculoskeletal disorders of construction workers

Multi-modal 3D Human Tracking for Robots in Complex Environment with Siamese Point-Video Transformer

Monocular 3D Multi-Person Pose Estimation for On-Site Joint Flexion Assessment: A Case of Extreme Knee Flexion Detection

Construction worker's awkward posture recognition through supervised motion tensor decomposition

Bidirectional Tracking Method for Construction Workers in Dealing with Identity Errors

Tracking multiple construction workers through deep learning and the gradient based method with re-matching based on multi-object tracking accuracy

Joint-Level Vision-Based Ergonomic Assessment Tool for Construction Workers

Multi-Worker Tracking Algorithm Based on Combined Feature Clustering

Real‐time ergonomic risk assessment in construction using a co‐learning‐powered 3D human pose estimation model

Vision-Based Construction Worker Activity Analysis Informed by Body Posture

A computer vision based method for 3D posture estimation of symmetrical lifting.

A Privacy-Preserving and Unobtrusive Sitting Posture Recognition System Via Pressure Array Sensor and Infrared Array Sensor for Office Workers

Personnel tracking on construction sites using video cameras

Image-and-Skeleton-Based Parameterized Approach to Real-Time Identification of Construction Workers' Unsafe Behaviors

Construction posture recognition with primitive joints extended planar normal vector quaternions

Construction worker detection in video frames for initializing vision trackers

Skeleton Cluster Tracking for robust multi-view multi-person 3D human pose estimation

Human Posture Tracking in a Multi-Camera Environment

Tracking People in Highly Dynamic Industrial Environments