[Fetotoxic effect of orthoxylol].

A. Hudák,E. Tátrai,M. Lörincz,G. Barcza,G. Ungváry

Abstract:

What problem does this paper attempt to address?

Semi-supervised learning approach for construction object detection by integrating super-resolution and mean teacher network

Wen-Jie Zhang,Hua-Ping Wan,Peng-Hua Hu,Hui-Bin Ge,Yaozhi Luo,Michael D. Todd

DOI: https://doi.org/10.1016/j.iintel.2024.100095

2024-01-01

Journal of Infrastructure Intelligence and Resilience

Abstract:Deep learning-based object detection methods are utilized for safety management at construction sites, which require large-scale, high-quality, and well-labeled datasets for training. The existing construction datasets are relatively small due to the high expense of labor-intensive annotation, and the varying quality of the construction images also affects the detection performance of the model. To address the limitations of datasets, this study proposes a new method for construction object detection by integrating super-resolution and semi-supervised learning. The proposed method improves the quality of construction images and achieves excellent detection performance with limited labeled data. First, the Real-ESRGAN model is introduced to improve the quality of construction images and make the construction objects visible. The proposed super-resolution method can enhance the texture details of low-resolution images, hence improving the performance of object detection models. Second, the mean-teacher network is adopted to expand the training set, thus avoiding the labor-intensive annotation work. To verify the effectiveness of the proposed method, the method is applied to the state-of-the-art Yolov5 object detection model, and construction images from the Site Object Detection Dataset (SODA) with different labeled data proportions (from 10% to 50% in 10% intervals with an extreme case of 5%) are used as the training set. By comparing with the existing supervised learning method, it is shown that the proposed method can achieve better detection performance. In particular, the method is more effective in enhancing detection performance when the proportion of the labeled data is smaller, which is of great practical value in real-world engineering. The experimental results show the potential of the proposed method in improving image quality and reducing the expense of developing construction datasets.
Deep semantic segmentation for visual understanding on construction sites

Zifeng Wang,Yuyang Zhang,Khalid M. Mosalam,Yuqing Gao,Shao‐Lun Huang

DOI: https://doi.org/10.1111/mice.12701

2021-05-07

Abstract:<p>Visual understanding on construction sites by deep learning, such as semantic segmentation, is hardly mentioned in the literature due to the severe lack of labeled data sets. To resolve this issue, we collect and label 859 images, including 12 classes of objects in construction activities, from different construction sites. We then adopt DeepLabV3+ on this data set with modifications. We leverage the Cityscape data set to pretrain the model, and then fine‐tune it on our collected data set. Moreover, multiple data augmentation techniques are utilized to expand the training data set. Our model reaches 0.6467 mean intersection over union (mIoU) and 92.62% mean pixel accuracy (mPA) in the out‐of‐sample test with the capability of processing over 45 frames per second with a resolution of pixels. In addition, we develop a synthetic robotic system integrated with red–green–blue (RGB)‐depth camera for visual understanding on sites. It can detect the depth information of objects and has high potential in automated construction and visual surveillance.</p>

transportation science & technology,construction & building technology,computer science, interdisciplinary applications,engineering, civil
Synthetic Datasets for Rebar Instance Segmentation Using Mask R-CNN

Wang,Ye,Wang,Zhu,Jiang,Liu

DOI: https://doi.org/10.3390/buildings13030585

IF: 3.324

2023-02-23

Buildings

Abstract:The construction and inspection of reinforcement rebar currently rely entirely on manual work, which leads to problems such as high labor requirements and labor costs. Rebar image detection using deep learning algorithms can be employed in construction quality inspection and intelligent construction; it can check the number, spacing, and diameter of rebar on a construction site, and guide robots to complete rebar tying. However, the application of deep learning algorithms relies on a large number of datasets to train models, while manual data collection and annotation are time-consuming and laborious. In contrast, using synthetic datasets can achieve a high degree of automation of annotation. In this study, using rebar as an example, we proposed a mask annotation methodology based on BIM software and rendering software, which can establish a large and diverse training set for instance segmentation, without manual labeling. The Mask R-CNN trained using both real and synthetic datasets demonstrated a better performance than the models trained using only real datasets or synthetic datasets. This synthetic dataset generation method could be widely used for various image segmentation tasks and provides a reference for other computer vision engineering tasks and deep learning tasks in related fields.

construction & building technology,engineering, civil
ConRebSeg: A Segmentation Dataset for Reinforced Concrete Construction

Patrick Schmidt,Lazaros Nalpantidis

2024-07-12

Abstract:The construction industry has been traditionally slow in adopting digital technologies. However, these are becoming increasingly necessary due to a plentitude of challenges, such as a shortage of skilled labor and decreasing productivity levels compared to other industries. Autonomous robotic systems can alleviate this problem, but the software development process for these systems is heavily driven by data, a resource usually challenging to find in the construction domain due to the lack of public availability. In our work, we therefore provide a dataset of 14,805 RGB images with segmentation labels for reinforced concrete construction and make it publicly available. We conduct a detailed analysis of our dataset and discuss how to deal with labeling inconsistencies. Furthermore, we establish baselines for the YOLOv8L-seg, DeepLabV3, and U-Net segmentation models and investigate the influence of data availability and label inconsistencies on the performance of these models. Our study showed that the models are precise in their predictions but would benefit from more data to increase the number of recalled instances. Label inconsistencies had a negligible effect on model performance, and we, therefore, advocate for a crowd-sourced dataset to boost the development of autonomous robotic systems in the construction industry.

Computer Vision and Pattern Recognition,Robotics
Semi-supervised learning for concrete defect segmentation from images

Wenjun Wang,Chao Su,Guohui Han,Shaopei Hu

DOI: https://doi.org/10.1177/14759217231217097

2024-01-15

Structural Health Monitoring

Abstract:Structural Health Monitoring, Ahead of Print. Deep learning-based concrete defect detection has emerged as a promising technology to overcome the limitations of manual visual inspection, which is often subjective, laborious, and time-consuming. However, most existing methods rely heavily on manual labels and adopt a fully supervised learning approach, which hinders their practical application in engineering. To tackle these concerns, we proposed a semi-supervised learning model, termed Semi-SegDefect. Our proposal utilizes a mean teacher architecture to assign pseudo-labels to the pixels of unlabeled images and performs pixel-level contrastive learning on a sparse set of hard negative pixels to achieve segmentation boundaries with the highest possible accuracy. Test results demonstrate that Semi-SegDefect outperforms fully supervised models significantly, especially when trained with limited labeled data. This method shows great promise for enhancing the accuracy and scalability of concrete defect segmentation and can contribute to the advancement of the construction industry.

engineering, multidisciplinary,instruments & instrumentation
Towards Urban Scene Semantic Segmentation with Deep Learning from LiDAR Point Clouds: A Case Study in Baden-Württemberg, Germany

Yanling Zou,Holger Weinacker,Barbara Koch

DOI: https://doi.org/10.3390/rs13163220

IF: 5

2021-08-13

Remote Sensing

Abstract:An accurate understanding of urban objects is critical for urban modeling, intelligent infrastructure planning and city management. The semantic segmentation of light detection and ranging (LiDAR) point clouds is a fundamental approach for urban scene analysis. Over the last years, several methods have been developed to segment urban furniture with point clouds. However, the traditional processing of large amounts of spatial data has become increasingly costly, both time-wise and financially. Recently, deep learning (DL) techniques have been increasingly used for 3D segmentation tasks. Yet, most of these deep neural networks (DNNs) were conducted on benchmarks. It is, therefore, arguable whether DL approaches can achieve the state-of-the-art performance of 3D point clouds segmentation in real-life scenarios. In this research, we apply an adapted DNN (ARandLA-Net) to directly process large-scale point clouds. In particular, we develop a new paradigm for training and validation, which presents a typical urban scene in central Europe (Munzingen, Freiburg, Baden-Württemberg, Germany). Our dataset consists of nearly 390 million dense points acquired by Mobile Laser Scanning (MLS), which has a rather larger quantity of sample points in comparison to existing datasets and includes meaningful object categories that are particular to applications for smart cities and urban planning. We further assess the DNN on our dataset and investigate a number of key challenges from varying aspects, such as data preparation strategies, the advantage of color information and the unbalanced class distribution in the real world. The final segmentation model achieved a mean Intersection-over-Union (mIoU) score of 54.4% and an overall accuracy score of 83.9%. Our experiments indicated that different data preparation strategies influenced the model performance. Additional RGB information yielded an approximately 4% higher mIoU score. Our results also demonstrate that the use of weighted cross-entropy with inverse square root frequency loss led to better segmentation performance than when other losses were considered.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
Building Extraction from Very-High-Resolution Remote Sensing Images Using Semi-Supervised Semantic Edge Detection

Liegang Xia,Xiongbo Zhang,Junxia Zhang,Haiping Yang,Tingting Chen

DOI: https://doi.org/10.3390/rs13112187

IF: 5

2021-06-03

Remote Sensing

Abstract:The automated detection of buildings in remote sensing images enables understanding the distribution information of buildings, which is indispensable for many geographic and social applications, such as urban planning, change monitoring and population estimation. The performance of deep learning in images often depends on a large number of manually labeled samples, the production of which is time-consuming and expensive. Thus, this study focuses on reducing the number of labeled samples used and proposing a semi-supervised deep learning approach based on an edge detection network (SDLED), which is the first to introduce semi-supervised learning to the edge detection neural network for extracting building roof boundaries from high-resolution remote sensing images. This approach uses a small number of labeled samples and abundant unlabeled images for joint training. An expert-level semantic edge segmentation model is trained based on labeled samples, which guides unlabeled images to generate pseudo-labels automatically. The inaccurate label sets and manually labeled samples are used to update the semantic edge model together. Particularly, we modified the semantic segmentation network D-LinkNet to obtain high-quality pseudo-labels. Specifically, the main network architecture of D-LinkNet is retained while the multi-scale fusion is added in its second half to improve its performance on edge detection. The SDLED was tested on high-spatial-resolution remote sensing images taken from Google Earth. Results show that the SDLED performs better than the fully supervised method. Moreover, when the trained models were used to predict buildings in the neighboring counties, our approach was superior to the supervised way, with line IoU improvement of at least 6.47% and F1 score improvement of at least 7.49%.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
Deep learning for semantic segmentation of remote sensing images with rich spectral content

A Hamida,A. Benoît,P. Lambert,L Klein,C Amar,N. Audebert,S. Lefèvre

DOI: https://doi.org/10.48550/arXiv.1712.01600

2017-12-05

Abstract:With the rapid development of Remote Sensing acquisition techniques, there is a need to scale and improve processing tools to cope with the observed increase of both data volume and richness. Among popular techniques in remote sensing, Deep Learning gains increasing interest but depends on the quality of the training data. Therefore, this paper presents recent Deep Learning approaches for fine or coarse land cover semantic segmentation estimation. Various 2D architectures are tested and a new 3D model is introduced in order to jointly process the spatial and spectral dimensions of the data. Such a set of networks enables the comparison of the different spectral fusion schemes. Besides, we also assess the use of a " noisy ground truth " (i.e. outdated and low spatial resolution labels) for training and testing the networks.

Computer Vision and Pattern Recognition,Machine Learning
Chemical synthesis of a polypeptide backbone derived from the primary sequence of the cancer protein NY‐ESO‐1 enabled by kinetically controlled ligation and pseudoprolines

P. Harris,M. Brimble

DOI: https://doi.org/10.1002/bip.22621

2015-03-01

Biopolymers

Abstract:The cancer protein NY‐ESO‐1 has been shown to be one of the most promising vaccine candidates although little is known about its cellular function. Using a chemical protein strategy, the 180 amino acid polypeptide, tagged with an arginine solubilizing tail, was assembled in a convergent manner from four unprotected peptide α‐thioester peptide building blocks and one cysteinyl polypeptide, which were in turn prepared by Boc and Fmoc solid phase peptide synthesis (SPPS) respectively. To facilitate the assembly by ligation chemistries, non‐native cysteines were introduced as chemical handles into the polypeptide fragments; pseudoproline dipeptides and microwave assisted Fmoc SPPS were crucial techniques to prepare the challenging hydrophobic C‐terminal fragment. Three sequential kinetically controlled ligations, which exploited the reactivity between peptide arylthioesters and peptide alkylthioesters, were then used in order to assemble the more tractable N‐terminal region of NY‐ESO‐1. The ensuing 147 residue polypeptide thioester then underwent successful final native chemical ligation with the very hydrophobic C‐terminal polypeptide bearing an N‐terminal cysteine affording the 186 residue polypeptide as an advanced intermediate en route to the native NY‐ESO‐1 protein. © 2015 Wiley Periodicals, Inc. Biopolymers (Pept Sci) 104: 116–127, 2015.
Automatic Quality Inspection of Rebar Spacing Using Vision-Based Deep Learning with RGBD Camera

Mi Liu,Lu Deng,Ran Cao,Songyue Wang,Jingjing Guo

DOI: https://doi.org/10.22260/isarc2024/0009

2024-06-03

Abstract:– Non-compliant rebar placement in reinforced concrete structures directly impacts the strength and durability of the overall structure. Current inspection methods heavily rely on manual techniques, introducing subjectivity and potential errors. This paper proposes a method for automatic quality inspection of rebar spacing using vision-based deep learning combined with RGBD camera. The method consists of three modules: (1) The image preprocessing module applies point cloud plane fitting techniques to eliminate the interference of the background rebar layer and rotate the image of the current rebar layer; (2) The recognition and localization module employs YOLOV8 keypoint detection algorithm to obtain pixel coordinates of rebar crosspoints, which are then transformed into spatial coordinates in the camera coordinate system; (3) The automatic inspection module proposes an automatic spacing measurement method based on the pixel coordinates of rebar crosspoints, enabling the inspection of all rebar spacings in the image and evaluating their compliance. Experimental results demonstrate the robustness of the pixel segmentation method, showcasing its applicability for compliance inspection with an average error of 2.65mm. The study concludes by suggesting potential directions for future research.

Computer Science,Engineering
Deep-learning-based visual data analytics for smart construction management

Aritra Pal,Shang-Hsien Hsieh

DOI: https://doi.org/10.1016/j.autcon.2021.103892

IF: 10.3

2021-11-01

Automation in Construction

Abstract:Visual data captured at construction sites is a rich source of information for the day-to-day operation of construction projects. The development of deep-learning-based methods has demonstrated their capabilities in analyzing complex visual data and inferring valuable insights. Recent applications of these methods in construction have also shown promising performance in making the construction management process smarter. To understand the current research trends and to highlight future research directions, this study reviews state-of-the-art deep-learning applications on visual data analytics in the context of construction project management. This in-depth review identifies six major fields and fifty-two subfields of construction management where deep-learning-based visual data analytics have been applied. It also proposes a generalized workflow for applying deep-learning-based visual data analytics methods for solving construction management problems. In addition, the study highlights three future research directions where deep-learning-based visual data analytics can be applied on relatively less explored 3D visual data.

construction & building technology,engineering, civil
Deep learning framework with Local Sparse Transformer for construction worker detection in 3D with LiDAR

Mingyu Zhang,Lei Wang,Shuai Han,Shuyuan Wang,Heng Li

DOI: https://doi.org/10.1111/mice.13238

IF: 10.066

2024-05-28

Computer-Aided Civil and Infrastructure Engineering

Abstract:Autonomous equipment is playing an increasingly important role in construction tasks. It is essential to equip autonomous equipment with powerful 3D detection capability to avoid accidents and inefficiency. However, there is limited research within the construction field that has extended detection to 3D. To this end, this study develops a light detection and ranging (LiDAR)‐based deep‐learning model for the 3D detection of workers on construction sites. The proposed model adopts a voxel‐based anchor‐free 3D object detection paradigm. To enhance the feature extraction capability for tough detection tasks, a novel Transformer‐based block is proposed, where the multi‐head self‐attention is applied in local grid regions. The detection model integrates the Transformer blocks with 3D sparse convolution to extract wide and local features while pruning redundant features in modified downsampling layers. To train and test the proposed model, a LiDAR point cloud dataset was created, which includes workers in construction sites with 3D box annotations. The experiment results indicate that the proposed model outperforms the baseline models with higher mean average precision and smaller regression errors. The method in the study is promising to provide worker detection with rich and accurate 3D information required by construction automation.

transportation science & technology,construction & building technology,computer science, interdisciplinary applications,engineering, civil
Building Precision: Efficient Encoder–Decoder Networks for Remote Sensing Based on Aerial RGB and LiDAR Data

Muhammad Sulaiman,Erik Finnesand,Mina Farmanbar,Ahmed Nabil Belbachir,Chunming Rong

DOI: https://doi.org/10.1109/access.2024.3391416

IF: 3.9

2024-05-03

IEEE Access

Abstract:Precision in building delineation plays a pivotal role in population data analysis, city management, policy making, and disaster management. Leveraging computer vision technologies, particularly deep learning models for semantic segmentation, has proven instrumental in achieving accurate automatic building segmentation in remote sensing applications. However, current state-of-the-art (SOTA) techniques are not optimized for precisely extracting building footprints and, specifically, boundaries of the building. This deficiency highlights the need to leverage Light Detection and Ranging (LiDAR) data in conjunction with aerial RGB and streamlined deep learning for improved precision. This work utilizes the MapAI dataset, which includes a variety of objects beyond buildings, such as trees, electricity lines, solar panels, vehicles, and roads. These objects showcase diverse colors and structures, mirroring the rooftops in Denmark and Norway. Due to the aforementioned problems, this study modified UNet and CT-UNet to use LiDAR data and RGB images to segment buildings using Intersection Over Union (IoU) to evaluate building overlap and Boundary Intersection Over Union (BIoU) to evaluate precise building boundaries and shapes. The proposed work changes the configuration of these networks to streamline with LiDAR data for efficient segmentation. The batch data in training is augmented to improve model generalization and overcome overfitting. Batch normalization inclusion also improves overfitting. Four backbones with transfer learning are employed to enhance convergence and parameter efficiency of segmentation: ResNet50V2, DenseNet201, EfficientNetB4, and EfficientNetV2S. Test-Time Augmentation (TTA) is employed to improve the predicted mask. Experiments are performed using single and ensemble models, with and without Augmentation. The ensemble model outperforms the single model, and TTA also improves the results. LiDAR data with RGB improves the combined score (average of IoU and BIoU) by 13.33% compared to only RGB images.

computer science, information systems,telecommunications,engineering, electrical & electronic
Intelligent Detection of Rebar Size and Position Using Improved DeeplabV3+

Wei Chen,Xianglin Fu,Wanqing Chen,Zijun Peng

DOI: https://doi.org/10.3390/app131911094

2023-01-01

Abstract:For the development of reinforced concrete structures and infrastructure construction, traditional rebar checking and acceptance methods have shortcomings in terms of efficiency. The use of digital image processing technology cannot easily identify a rebar configuration with complex and diverse backgrounds. To solve this problem, an inspection method combining deep learning and digital image processing techniques is proposed using an improved DeeplabV3+ model to identify reinforcing bars, with the identification results subjected to digital image processing operations to obtain the size information of the reinforcing bar. The proposed method was validated through a field test. The results of the experiment indicated that the proposed model is more accurate than other models, with a mean Intersection over Union (mIoU), precision, recall, and F1 score reaching 94.62%, 97.42%, 96.95%, and 97.18%, respectively. Moreover, the accuracy of the dimension estimations for the test reinforcements met the engineering acceptance standards.
The Neural Correlates of Intelligence Comparison

Xue Wen,Jonathan S. Cant,Yanhui Xiang,Ruiwang Huang,L. Mo

DOI: https://doi.org/10.1093/cercor/bhx329

IF: 4.861

Cerebral Cortex

Abstract:Social comparison plays an important role in our daily life. Several studies have investigated the neural mechanism of social comparison; however, their conclusions remain controversial. The present study explored the neural correlates of intelligence comparison and nonsocial size comparison using functional magnetic resonance imaging and a distance effect paradigm. We found that both intelligence and size comparisons obeyed the behavioral distance effect-longer response times for near than far distances and this effect involved an overlapping frontal network including the dorsomedial prefrontal cortex and insula. In addition, compared with size comparisons, intelligence comparisons elicited increased activity in the precuneus and angular gyrus, but decreased activity in the inferior parietal lobe. Furthermore, the analysis of seed-based functional connectivity complemented these neural commonalities and differences. Our findings suggest that social and nonsocial comparisons may rely on a common core mechanism, but this mechanism may be supplemented by different domain-specific cognitive components.
AIDCON: An Aerial Image Dataset and Benchmark for Construction Machinery

Ahmet Bahaddin Ersoz,Onur Pekcan,Emre Akbas

DOI: https://doi.org/10.3390/rs16173295

IF: 5

2024-09-05

Remote Sensing

Abstract:Applying deep learning algorithms in the construction industry holds tremendous potential for enhancing site management, safety, and efficiency. The development of such algorithms necessitates a comprehensive and diverse image dataset. This study introduces the Aerial Image Dataset for Construction (AIDCON), a novel aerial image collection containing 9563 construction machines across nine categories annotated at the pixel level, carrying critical value for researchers and professionals seeking to develop and refine object detection and segmentation algorithms across various construction projects. The study highlights the benefits of utilizing UAV-captured images by evaluating the performance of five cutting-edge deep learning algorithms—Mask R-CNN, Cascade Mask R-CNN, Mask Scoring R-CNN, Hybrid Task Cascade, and Pointrend—on the AIDCON dataset. It underscores the significance of clustering strategies for generating reliable and robust outcomes. The AIDCON dataset's unique aerial perspective aids in reducing occlusions and provides comprehensive site overviews, facilitating better object positioning and segmentation. The findings presented in this paper have far-reaching implications for the construction industry, as they enhance construction site efficiency while setting the stage for future advancements in construction site monitoring and management utilizing remote sensing technologies.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
Automatic damage detection and segmentation using deep learning algorithms in reinforced concrete structure inspections

Jiehui Wang,Tamon Ueda

DOI: https://doi.org/10.1002/suco.202400722

2024-10-17

Structural Concrete

Abstract:Traditional methods of detecting concrete damage, such as manual inspection, are typically slow, labor‐intensive, and subjective. Integrating deep learning algorithms has automated this process, representing a significant advance in building damage inspection. Semantic segmentation, a technique within deep learning, is increasingly recognized for its capability to identify the location and shape of concrete damage accurately. Unlike basic deep learning approaches like classification and object detection, semantic segmentation not only recognizes damage but also delineates its boundaries, and has great potential in facilitating dimension measurement. However, multi‐level, high‐precision detection for various structural damage assessments remains an area requiring further research. This study created a database of reinforced concrete surfaces with pixel‐level, multi‐category semantic segmentation annotations for various levels of component damage, including cracks and spalling of concrete, exposure, buckling, fracture of reinforcing bars, etc. The performance of advanced deep learning segmentation algorithms, including U‐Net, DeepLab, K‐Net, and FastSCNN, was consequently trained and evaluated in detecting various types of concrete damage. All models show good accuracy of more than 98%, but lower F1 scores around 70%. U‐Net and K‐Net demonstrate relatively stable performance, indicating a certain degree of consistency and a high‐performance peak. In contrast, DeepLabv3's F1 score fluctuates significantly, suggesting the model may suffer from overfitting or other stability issues during training, resulting in a relatively low average performance. FastSCNN exhibits the highest potential, achieving the highest F1 score. In addition, this study also tested the performance of each model on new damage images and explored the impact of the dataset proportion ratio (training set vs. validation set), contributing to providing insights into each algorithm's suitability for various inspection scenarios. Finally, perspectives on current challenges and future directions in the field have also been given.

construction & building technology,engineering, civil
Deep learning-based recognition of construction activities in real construction site environment

Ibrahim Karatas,Abdulkadir Budak

DOI: https://doi.org/10.1108/ecam-08-2024-1036

2024-12-05

Engineering Construction & Architectural Management

Abstract:Purpose Today's technological advancements have had a significant impact on the construction industry. Managing and controlling complex construction projects has been made significantly easier using technological tools. One such advancement is the automatic identification of workers' activities. This study aims to classify construction worker activities by analyzing real-time motion data collected from sensors. Design/methodology/approach In accordance with our specific goals, we utilized advanced deep-learning methodologies such as deep neural networks, convolutional neural network, long short-term memory and convolutional long short-term memory to analyze the data thoroughly. This involved experimenting with various window sizes and overlap ratios to determine the optimal combination that would result in the most accurate predictions. Findings Based on the analysis results, the convolutional long short-term memory (ConvLSTM) deep learning model with a window size of 4.8 s and an overlap rate of 75% was found to be the most accurate prediction model. This model correctly predicted 98.64% of the basic construction worker activities in a real construction site environment. Originality/value Previous studies have mainly been conducted in laboratory environments and have focused on basic construction activities such as lifting, moving, sawing and hammering. However, this study collected data from real workers in a real construction site environment. Various deep learning models were employed to determine the most accurate one. Additionally, several options were tested to determine the optimal window size and overlap ratio during the data segmentation phase, aiming to select the most suitable ones for preparing the data for the model.

engineering, civil, industrial,management
Content-Based Image Retrieval for Construction Site Images: Leveraging Deep Learning–Based Object Detection

Yiheng Wang,Bo Xiao,Ahmed Bouferguene,Mohamed Al-Hussein,Heng Li

DOI: https://doi.org/10.1061/jccee5.cpeng-5473

IF: 5.802

2023-11-01

Journal of Computing in Civil Engineering

Abstract:Visual data comprising images and videos has become an integral aspect of construction management, potentially supplanting traditional paper-based site documentation. With the vast amount of image data generated in construction projects, an efficient retrieval system that not only enhances visual data documentation but also promotes reutilization is needed. Existing label-based image retrieval methods for construction images require manual labeling and ignore visual information. Moreover, other content-based methods that consider visual properties of construction images are limited to utilizing simple visual features of the entire image. This poses a challenge when attempting to retrieve target images from the same construction site or those involving similar construction activities, particularly considering that construction images often share similar visual properties. This research introduces a content-based image retrieval method that employs object detection to identify significant subregions within construction images and convolutional neural networks to extract refined visual features of these subregions. By simply inputting a query image, the proposed method can accurately retrieve target construction images of interest. The proposed method was validated through experiments designed to retrieve target images in both same-site and same-activity retrieval scenarios. The proposed method achieved the best mean average precision (86.4%). This technology could contribute to construction data management and decision-making processes by providing an efficient information retrieval system.

computer science, interdisciplinary applications,engineering, civil
Road Environment Semantic Segmentation with Deep Learning from MLS Point Cloud Data

Jesús Balado,Joaquín Martínez-Sánchez,Pedro Arias,Ana Novo,Balado,Martínez-Sánchez,Arias,Novo

DOI: https://doi.org/10.3390/s19163466

IF: 3.9

2019-08-08

Sensors

Abstract:In the near future, the communication between autonomous cars will produce a network of sensors that will allow us to know the state of the roads in real time. Lidar technology, upon which most autonomous cars are based, allows the acquisition of 3D geometric information of the environment. The objective of this work is to use point clouds acquired by Mobile Laser Scanning (MLS) to segment the main elements of road environment (road surface, ditches, guardrails, fences, embankments, and borders) through the use of PointNet. Previously, the point cloud was automatically divided into sections in order for semantic segmentation to be scalable to different case studies, regardless of their shape or length. An overall accuracy of 92.5% has been obtained, but with large variations between classes. Elements with a greater number of points have been segmented more effectively than the other elements. In comparison with other point-by-point extraction and ANN-based classification techniques, the same success rates have been obtained for road surfaces and fences, and better results have been obtained for guardrails. Semantic segmentation with PointNet is suitable when segmenting the scene as a whole, however, if certain classes have more interest, there are other alternatives that do not need a high training cost.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation

[Fetotoxic effect of orthoxylol].

Semi-supervised learning approach for construction object detection by integrating super-resolution and mean teacher network

Deep semantic segmentation for visual understanding on construction sites

Synthetic Datasets for Rebar Instance Segmentation Using Mask R-CNN

ConRebSeg: A Segmentation Dataset for Reinforced Concrete Construction

Semi-supervised learning for concrete defect segmentation from images

Towards Urban Scene Semantic Segmentation with Deep Learning from LiDAR Point Clouds: A Case Study in Baden-Württemberg, Germany

Building Extraction from Very-High-Resolution Remote Sensing Images Using Semi-Supervised Semantic Edge Detection

Deep learning for semantic segmentation of remote sensing images with rich spectral content

Chemical synthesis of a polypeptide backbone derived from the primary sequence of the cancer protein NY‐ESO‐1 enabled by kinetically controlled ligation and pseudoprolines

Automatic Quality Inspection of Rebar Spacing Using Vision-Based Deep Learning with RGBD Camera

Deep-learning-based visual data analytics for smart construction management

Deep learning framework with Local Sparse Transformer for construction worker detection in 3D with LiDAR

Building Precision: Efficient Encoder–Decoder Networks for Remote Sensing Based on Aerial RGB and LiDAR Data

Intelligent Detection of Rebar Size and Position Using Improved DeeplabV3+

The Neural Correlates of Intelligence Comparison

AIDCON: An Aerial Image Dataset and Benchmark for Construction Machinery

Automatic damage detection and segmentation using deep learning algorithms in reinforced concrete structure inspections

Deep learning-based recognition of construction activities in real construction site environment

Content-Based Image Retrieval for Construction Site Images: Leveraging Deep Learning–Based Object Detection

Road Environment Semantic Segmentation with Deep Learning from MLS Point Cloud Data