Abstract:Deep learning-based object detection methods are utilized for safety management at construction sites, which require large-scale, high-quality, and well-labeled datasets for training. The existing construction datasets are relatively small due to the high expense of labor-intensive annotation, and the varying quality of the construction images also affects the detection performance of the model. To address the limitations of datasets, this study proposes a new method for construction object detection by integrating super-resolution and semi-supervised learning. The proposed method improves the quality of construction images and achieves excellent detection performance with limited labeled data. First, the Real-ESRGAN model is introduced to improve the quality of construction images and make the construction objects visible. The proposed super-resolution method can enhance the texture details of low-resolution images, hence improving the performance of object detection models. Second, the mean-teacher network is adopted to expand the training set, thus avoiding the labor-intensive annotation work. To verify the effectiveness of the proposed method, the method is applied to the state-of-the-art Yolov5 object detection model, and construction images from the Site Object Detection Dataset (SODA) with different labeled data proportions (from 10% to 50% in 10% intervals with an extreme case of 5%) are used as the training set. By comparing with the existing supervised learning method, it is shown that the proposed method can achieve better detection performance. In particular, the method is more effective in enhancing detection performance when the proportion of the labeled data is smaller, which is of great practical value in real-world engineering. The experimental results show the potential of the proposed method in improving image quality and reducing the expense of developing construction datasets.

An Improved Mean Teacher Based Method for Large Scale Weakly Labeled Semi-Supervised Sound Event Detection

Weakly and semi-supervised learning for sound event detection using image pretrained convolutional recurrent neural network, weighted pooling and mean teacher method

Semi-supervised learning approach for construction object detection by integrating super-resolution and mean teacher network

A Multi-grained based Attention Network for Semi-supervised Sound Event Detection

Active Learning for Sound Event Detection

A Joint Detection-Classification Model for Weakly Supervised Sound Event Detection Using Multi-Scale Attention Method

Multi-dimensional frequency dynamic convolution with confident mean teacher for sound event detection

Human–machine collaboration based sound event detection

Cross-Referencing Self-Training Network for Sound Event Detection in Audio Mixtures

A scene-dependent sound event detection approach using multi-task learning

MTDA-HSED: Mutual-Assistance Tuning and Dual-Branch Aggregating for Heterogeneous Sound Event Detection

On Local Temporal Embedding for Semi-Supervised Sound Event Detection

Weakly supervised CRNN system for sound event detection with large-scale unlabeled in-domain data

Sound Event Detection and Time-Frequency Segmentation from Weakly Labelled Data

Domestic sound event detection by shift consistency mean-teacher training and adversarial domain adaptation

Sound Event Detection by Multitask Learning of Sound Events and Scenes with Soft Scene Labels

Sound Event Detection and Time–Frequency Segmentation from Weakly Labelled Data

Teacher-Student Framework for Polyphonic Semi-supervised Sound Event Detection: Survey and Empirical Analysis

Leveraging Audio-Tagging Assisted Sound Event Detection using Weakified Strong Labels and Frequency Dynamic Convolutions

Dual Mean-Teacher: An Unbiased Semi-Supervised Framework for Audio-Visual Source Localization

RCT: Random Consistency Training for Semi-supervised Sound Event Detection