Abstract:Multiple construction worker tracking is an active research area critical to the planning of the job site. Challenges in multiple construction worker tracking include miss detection and mismatch due to occlusion and identity switches. To the best knowledge of the authors, the mismatch is not reported in the literature of construction for image based single camera multiple worker tracking. As a result, the mismatch should be taken into account through a representative performance index such as the Multi-Object Tracking Accuracy (MOTA). This work aims to improve the performance of the current multiple worker tracking through an approach composed of three stages: detection, matching and re-matching. In the detection stage, the deep learning detector, Mask R-CNN, is utilized. In the matching stage, we attempt to track workers between consecutive image frames through a gradient based method with feature based comparison. Several cost means and matching methods have been experimented for model selection. Trajectories of tracking objects are derived in this stage. The best cost measurements and matching methods are recommended. Trajectories of tracking objects could be interrupted because of miss detection or mismatch. We call those broken trajectories, without matched detections, orphans. In the re-matching stage, we attempt to recover unmatched detections in the current frame with previous orphans based on extracted features. A competitive MOTA of 56.7% was obtained from the proposed approach over MOTA of 55.9% from the state-of-the-art Detect-And-Track model on a human tracking benchmark dataset. On construction job sites, we have tested the approach with 4 testing videos, resulting in a total MOTA of 81.8%, average MOTA per video of 79.0% and standard deviation of 13.0%, while the maximum and minimum MOTAs are 96.0% and 69.0%, respectively. As a result, the proposed work could potentially provide better multiple worker tracking on the construction job site. Additionally, to have a better representation of the tracking errors, this work suggests to utilize the MOTA for multiple construction worker tracking.

Vision-Based Method Integrating Deep Learning Detection for Tracking Multiple Construction Machines

Vision-based Method for Tracking Workers by Integrating Deep Learning Instance Segmentation in Off-Site Construction

A Vision-Based Method for Automatic Tracking of Construction Machines at Nighttime Based on Deep Learning Illumination Enhancement

Automatic Recognition of Construction Worker Activities Using Dense Trajectories

Tracking multiple construction workers through deep learning and the gradient based method with re-matching based on multi-object tracking accuracy

Vision-Based Action Recognition Of Construction Workers Using Dense Trajectories

Object-Level Pseudo-3D Lifting for Distance-Aware Tracking

Deep Learning Detection for Real-time Construction Machine Checking

2D Part-Based Visual Tracking of Hydraulic Excavators

Computer Vision for Construction Progress Monitoring: A Real-Time Object Detection Approach

Two-Dimensional Visual Tracking in Construction Scenarios: A Comparative Study

MM-Tracker: Visual Tracking with A Multi-Task Model Integrating Detection and Differentiating Feature Extraction

Multitask Learning Method for Detecting the Visual Focus of Attention of Construction Workers

Vision-Based Excavator Detection and Tracking Using Hybrid Kinematic Shapes and Key Nodes

Tracking indoor construction progress by deep-learning-based analysis of site surveillance video

Enclosing Contour Tracking of Highway Construction Equipment Based on Orientation-Aware Bounding Box Using UAV

Enhanced Detection Model and Joint Scoring Strategy for Multi-Vehicle Tracking

Multi-Object Detection Method in Construction Machinery Swarm Operations Based on the Improved YOLOv4 Model

CML-MOTS: Collaborative Multi-task Learning for Multi-Object Tracking and Segmentation

Target Detection for Construction Machinery Based on Deep Learning and Multisource Data Fusion

Bidirectional Tracking Method for Construction Workers in Dealing with Identity Errors