Abstract:Sensing and reality capture devices are widely used in construction sites. Among different technologies, vision-based sensors are by far the most common and ubiquitous. A large volume of images and videos is collected from construction projects every day to track work progress, measure productivity, litigate claims, and monitor safety compliance. Manual interpretation of such colossal amounts of data, however, is non-trivial, error-prone, and resource-intensive. This has motivated new research on soft computing methods that utilize high-power data processing, computer vision, and deep learning (DL) in the form of convolutional neural networks (CNNs). A fundamental step toward machine-driven interpretation of construction site scenery is to accurately identify objects of interest for a particular problem. The accuracy requirement, however, may offset the computational speed of the candidate method. While lightweight DL algorithms (e.g., Mask R-CNN) can perform visual recognition with relatively high accuracy, they suffer from low processing efficacy, which hinders their use in real-time decision-making. One of the most promising DL algorithms that balance speed and accuracy is YOLO (you-only-look-once). This paper investigates YOLO-based CNN models in fast detection of construction objects. First, a large-scale image dataset, named Pictor-v2, is created, which contains about 3,500 images and approximately 11,500 instances of common construction site objects (e.g., building, equipment, worker). To assess the agility of object detection, transfer learning is used to train two variations of this model, namely, YOLO-v2 and YOLO-v3, and test them on different data combinations (crowdsourced, web-mined, or both). Results indicate that performance is higher if the model is trained on both crowdsourced and web-mined images. Additionally, YOLO-v3 outperforms YOLO-v2 by focusing on smaller, harder-to-detect objects. The best-performing YOLO-v3 model has a 78.2% mAP when tested on crowdsourced data. Sensitivity analysis of the output shows that the model's strong suit is in detecting larger objects in less crowded and well-lit spaces. The proposed methodology can also be extended to predict the relative distance of the detected objects with reliable accuracy. Findings of this work lay the foundation for further research on technology-assistive systems to augment human capacities in quickly and reliably interpreting visual data in complex environments.

Deep learning and ubiquitous systems for disabled people detection using YOLO models

Investigating YOLO Models Towards Outdoor Obstacle Detection For Visually Impaired People

HGR-FYOLO: a robust hand gesture recognition system for the normal and physically impaired person using frozen YOLOv5

YOLO-ABD: A Multi-Scale Detection Model for Pedestrian Anomaly Behavior Detection

Real-Time Detection and Analysis of Vehicles and Pedestrians using Deep Learning

Human Activities Detection using DeepLearning Technique- YOLOv8

Enhanced Yolov8 with OpenCV for Blind-Friendly Object Detection and Distance Estimation

Applying Image Analysis to Build a Lightweight System for Blind Obstacles Detecting of Intelligent Wheelchairs

Improved Detection and Tracking of Objects Based on a Modified Deep Learning Model (YOLOv5)

YOLO Series for Human Hand Action Detection and Classification from Egocentric Videos

Vision AI: A Deep Learning-Based Object Recognition System for Visually Impaired People Using TensorFlow and OpenCV

Leveraging YOLOv5s with optimization‐based effective anomaly detection in pedestrian walkways

Improving smart home surveillance through YOLO model with transfer learning and quantization for enhanced accuracy and efficiency

Deep Convolutional Networks for Construction Object Detection Under Different Visual Conditions

Advancing Roadway Sign Detection with YOLO Models and Transfer Learning

YOLOpeds: Efficient Real-Time Single-Shot Pedestrian Detection for Smart Camera Applications

MODIPHY: Multimodal Obscured Detection for IoT using PHantom Convolution-Enabled Faster YOLO

Human detection based on deep learning YOLO-v2 for real-time UAV applications

Real-Time Object Detection in Occluded Environment with Background Cluttering Effects Using Deep Learning

P-YOLOv8: Efficient and Accurate Real-Time Detection of Distracted Driving