Abstract:Sensing and reality capture devices are widely used in construction sites. Among different technologies, vision-based sensors are by far the most common and ubiquitous. A large volume of images and videos is collected from construction projects every day to track work progress, measure productivity, litigate claims, and monitor safety compliance. Manual interpretation of such colossal amounts of data, however, is non-trivial, error-prone, and resource-intensive. This has motivated new research on soft computing methods that utilize high-power data processing, computer vision, and deep learning (DL) in the form of convolutional neural networks (CNNs). A fundamental step toward machine-driven interpretation of construction site scenery is to accurately identify objects of interest for a particular problem. The accuracy requirement, however, may offset the computational speed of the candidate method. While lightweight DL algorithms (e.g., Mask R-CNN) can perform visual recognition with relatively high accuracy, they suffer from low processing efficacy, which hinders their use in real-time decision-making. One of the most promising DL algorithms that balance speed and accuracy is YOLO (you-only-look-once). This paper investigates YOLO-based CNN models in fast detection of construction objects. First, a large-scale image dataset, named Pictor-v2, is created, which contains about 3,500 images and approximately 11,500 instances of common construction site objects (e.g., building, equipment, worker). To assess the agility of object detection, transfer learning is used to train two variations of this model, namely, YOLO-v2 and YOLO-v3, and test them on different data combinations (crowdsourced, web-mined, or both). Results indicate that performance is higher if the model is trained on both crowdsourced and web-mined images. Additionally, YOLO-v3 outperforms YOLO-v2 by focusing on smaller, harder-to-detect objects. The best-performing YOLO-v3 model has a 78.2% mAP when tested on crowdsourced data. Sensitivity analysis of the output shows that the model's strong suit is in detecting larger objects in less crowded and well-lit spaces. The proposed methodology can also be extended to predict the relative distance of the detected objects with reliable accuracy. Findings of this work lay the foundation for further research on technology-assistive systems to augment human capacities in quickly and reliably interpreting visual data in complex environments.

Single-Shot Visual Relationship Detection for the Accurate Identification of Contact-Driven Hazards in Sustainable Digitized Construction

Visual relationship detection with a deep convolutional relationship network

Monocular 2D Camera-based Proximity Monitoring for Human-Machine Collision Warning on Construction Sites

Deep learning‐based object identification with instance segmentation and pseudo‐LiDAR point cloud for work zone safety

Using Context-Guided data Augmentation, lightweight CNN, and proximity detection techniques to improve site safety monitoring under occlusion conditions

Risk Factor Recognition for Automatic Safety Management in Construction Sites Using Fast Deep Convolutional Neural Networks

A deep learning-enhanced Digital Twin framework for improving safety and reliability in human–robot collaborative manufacturing

A deep-learning approach to leveraging natural hazard indicators for improved safety on construction sites

Construction Site Safety Management: A Computer Vision and Deep Learning Approach

Construction Site Hazards Identification Using Deep Learning and Computer Vision

Computer vision and long short-term memory: Learning to predict unsafe behaviour in construction

SRGAN-enhanced unsafe operation detection and classification of heavy construction machinery using cascade learning

Improving safety in physical human-robot collaboration via deep metric learning

Unmanned Aerial Systems and Deep Learning for Safety and Health Activity Monitoring on Construction Sites

Few-shot object detection and attribute recognition from construction site images for improved field compliance

Real-time monitoring of work-at-height safety hazards in construction sites using drones and deep learning

Real‐time 3D multi‐pedestrian detection and tracking using 3D LiDAR point cloud for mobile robot

Real-time smart video surveillance to manage safety: A case study of a transport mega-project

Deep Convolutional Networks for Construction Object Detection Under Different Visual Conditions

Real-time mixed reality-based visual warning for construction workforce safety

Single shot relation detector for pedestrian detection