Abstract:Multiple construction worker tracking is an active research area critical to the planning of the job site. Challenges in multiple construction worker tracking include miss detection and mismatch due to occlusion and identity switches. To the best knowledge of the authors, the mismatch is not reported in the literature of construction for image based single camera multiple worker tracking. As a result, the mismatch should be taken into account through a representative performance index such as the Multi-Object Tracking Accuracy (MOTA). This work aims to improve the performance of the current multiple worker tracking through an approach composed of three stages: detection, matching and re-matching. In the detection stage, the deep learning detector, Mask R-CNN, is utilized. In the matching stage, we attempt to track workers between consecutive image frames through a gradient based method with feature based comparison. Several cost means and matching methods have been experimented for model selection. Trajectories of tracking objects are derived in this stage. The best cost measurements and matching methods are recommended. Trajectories of tracking objects could be interrupted because of miss detection or mismatch. We call those broken trajectories, without matched detections, orphans. In the re-matching stage, we attempt to recover unmatched detections in the current frame with previous orphans based on extracted features. A competitive MOTA of 56.7% was obtained from the proposed approach over MOTA of 55.9% from the state-of-the-art Detect-And-Track model on a human tracking benchmark dataset. On construction job sites, we have tested the approach with 4 testing videos, resulting in a total MOTA of 81.8%, average MOTA per video of 79.0% and standard deviation of 13.0%, while the maximum and minimum MOTAs are 96.0% and 69.0%, respectively. As a result, the proposed work could potentially provide better multiple worker tracking on the construction job site. Additionally, to have a better representation of the tracking errors, this work suggests to utilize the MOTA for multiple construction worker tracking.

Multi-Worker Tracking Algorithm Based on Combined Feature Clustering

Online Multipedestrian Tracking Based on Fused Detections of Millimeter Wave Radar and Vision

Online Multi-Object Tracking from A Bird's-Eye View by Fusion of Millimeter-Wave Radar and Vision

Tracking multiple construction workers through deep learning and the gradient based method with re-matching based on multi-object tracking accuracy

A novel multi-target multi-camera tracking approach based on feature grouping

Vision-Based Real-Time Posture Tracking for Multiple Construction Workers

Multi-target tracking based on appearance features and similarity fusion

Vision Based Multi-pedestrian Tracking Using Adaptive Detection and Clustering.

MM-Tracker: Visual Tracking with A Multi-Task Model Integrating Detection and Differentiating Feature Extraction

Multi-features Guided Robust Visual Tracking.

Adaptive Multi-Pedestrian Tracking by Multi-Sensor: Track-to-Track Fusion Using Monocular 3D Detection and MMW Radar

Personnel tracking on construction sites using video cameras

Bidirectional Tracking Method for Construction Workers in Dealing with Identity Errors

3D Multi-Object Online Tracking with Multi-View Clustering

Multiple object tracking with appearance feature prediction and similarity fusion

Multi-Pedestrian Tracking with Clusters

Online Multi-target Tracking for Pedestrian by Fusion of Millimeter Wave Radar and Vision

Multitarget Occlusion Tracking With 3-D Spatio-Temporal Context Graph Model

An anti-occlusion optimization algorithm for multiple pedestrian tracking

An End-to-end Tracking Framework Via Multi-View and Temporal Feature Aggregation

Real-time Multi-Object Tracking Based on Bi-directional Matching