Abstract:Deep learning-based object detection methods are utilized for safety management at construction sites, which require large-scale, high-quality, and well-labeled datasets for training. The existing construction datasets are relatively small due to the high expense of labor-intensive annotation, and the varying quality of the construction images also affects the detection performance of the model. To address the limitations of datasets, this study proposes a new method for construction object detection by integrating super-resolution and semi-supervised learning. The proposed method improves the quality of construction images and achieves excellent detection performance with limited labeled data. First, the Real-ESRGAN model is introduced to improve the quality of construction images and make the construction objects visible. The proposed super-resolution method can enhance the texture details of low-resolution images, hence improving the performance of object detection models. Second, the mean-teacher network is adopted to expand the training set, thus avoiding the labor-intensive annotation work. To verify the effectiveness of the proposed method, the method is applied to the state-of-the-art Yolov5 object detection model, and construction images from the Site Object Detection Dataset (SODA) with different labeled data proportions (from 10% to 50% in 10% intervals with an extreme case of 5%) are used as the training set. By comparing with the existing supervised learning method, it is shown that the proposed method can achieve better detection performance. In particular, the method is more effective in enhancing detection performance when the proportion of the labeled data is smaller, which is of great practical value in real-world engineering. The experimental results show the potential of the proposed method in improving image quality and reducing the expense of developing construction datasets.

Construction Scene Parsing (CSP): Structured Annotations of Image Segmentation for Construction Semantic Understanding

Semi-supervised learning approach for construction object detection by integrating super-resolution and mean teacher network

ConstScene: Dataset and Model for Advancing Robust Semantic Segmentation in Construction Environments

Deep semantic segmentation for visual understanding on construction sites

Construction Instance Segmentation (CIS) Dataset for Deep Learning-Based Computer Vision

Scene Parsing through ADE20K Dataset

Temporal Pixel-Level Semantic Understanding Through the VSPW Dataset

ETHcavation: A Dataset and Pipeline for Panoptic Scene Understanding and Object Tracking in Dynamic Construction Environments

Special Perceptual Parsing for Chinese Landscape Painting Scene Understanding: a Semantic Segmentation Approach.

VCVW-3D: A Virtual Construction Vehicles and Workers Dataset with 3D Annotations

Deep Structured Scene Parsing by Learning with Image Descriptions

VSPW: A Large-scale Dataset for Video Scene Parsing in the Wild

Weakly-supervised Scene Parsing with Multiple Contextual Cues

Semantic Understanding of Scenes Through the ADE20K Dataset

The Fieldscapes Dataset for Semantic Field Scene Understanding

Traffic Scene Parsing through the TSP6K Dataset

SODA: Site Object Detection dAtaset for Deep Learning in Construction

Towards Panoptic 3D Parsing for Single Image in the Wild

Vision-based method for semantic information extraction in construction by integrating deep learning object detection and image captioning

SODA: A Large-Scale Open Site Object Detection Dataset for Deep Learning in Construction

Scene restoration from scaffold occlusion using deep learning-based methods