Abstract:Multiple construction worker tracking is an active research area critical to the planning of the job site. Challenges in multiple construction worker tracking include miss detection and mismatch due to occlusion and identity switches. To the best knowledge of the authors, the mismatch is not reported in the literature of construction for image based single camera multiple worker tracking. As a result, the mismatch should be taken into account through a representative performance index such as the Multi-Object Tracking Accuracy (MOTA). This work aims to improve the performance of the current multiple worker tracking through an approach composed of three stages: detection, matching and re-matching. In the detection stage, the deep learning detector, Mask R-CNN, is utilized. In the matching stage, we attempt to track workers between consecutive image frames through a gradient based method with feature based comparison. Several cost means and matching methods have been experimented for model selection. Trajectories of tracking objects are derived in this stage. The best cost measurements and matching methods are recommended. Trajectories of tracking objects could be interrupted because of miss detection or mismatch. We call those broken trajectories, without matched detections, orphans. In the re-matching stage, we attempt to recover unmatched detections in the current frame with previous orphans based on extracted features. A competitive MOTA of 56.7% was obtained from the proposed approach over MOTA of 55.9% from the state-of-the-art Detect-And-Track model on a human tracking benchmark dataset. On construction job sites, we have tested the approach with 4 testing videos, resulting in a total MOTA of 81.8%, average MOTA per video of 79.0% and standard deviation of 13.0%, while the maximum and minimum MOTAs are 96.0% and 69.0%, respectively. As a result, the proposed work could potentially provide better multiple worker tracking on the construction job site. Additionally, to have a better representation of the tracking errors, this work suggests to utilize the MOTA for multiple construction worker tracking.

Two-Dimensional Visual Tracking in Construction Scenarios: A Comparative Study

Robust Visual Tracking Via CAMShift and Structural Local Sparse Appearance Model

Beyond Traditional Driving Scenes: A Robotic-Centric Paradigm for 2D+3D Human Tracking Using Siamese Transformer Network

Personnel tracking on construction sites using video cameras

Vision-Based Real-Time Posture Tracking for Multiple Construction Workers

Real-Time Three-Dimensional Occupancy Grid Modeling for the Detection and Tracking of Construction Resources

Tracking multiple construction workers through deep learning and the gradient based method with re-matching based on multi-object tracking accuracy

Tracking indoor construction progress by deep-learning-based analysis of site surveillance video

Construction worker detection in video frames for initializing vision trackers

Multi-features Guided Robust Visual Tracking.

Bidirectional Tracking Method for Construction Workers in Dealing with Identity Errors

Visual Sensor Target Tracking and Localization Method for Automatic Excavators

Reidentification-Based Automated Matching for 3D Localization of Workers in Construction Sites

Multi-Worker Tracking Algorithm Based on Combined Feature Clustering

Object-Level Pseudo-3D Lifting for Distance-Aware Tracking

A Review of Computer Vision-Based Monitoring Approaches for Construction Workers’ Work-Related Behaviors

Applications of Computer Vision in Monitoring the Unsafe Behavior of Construction Workers: Current Status and Challenges

Tracking as A Whole: Multi-Target Tracking by Modeling Group Behavior with Sequential Detection

Computer Vision for Construction Progress Monitoring: A Real-Time Object Detection Approach

In vitro continuous cultivation of Trypanosoma theileri utilizing a modified Splitter's medium.

Stereo Camera Visual SLAM with Hierarchical Masking and Motion-state Classification at Outdoor Construction Sites Containing Large Dynamic Objects