Abstract:Deep learning-based (DL) visual recognition algorithms are widely investigated to enhance the accuracy, efficiency, and objectivity of the bridge inspection process, which is largely manual today. These algorithms typically require a large amount of training data, which consists of images and corresponding annotations. The manual preparation of such data sets is time-consuming, and more automated data generation approaches that are aided by synthetic environments suffer from domain gaps, which result in poor performance in real-world tasks. This study investigates an unsupervised domain adaptation (UDA) approach for visual recognition in bridge inspection scenes to reduce and eventually eliminate the need for time-consuming and inaccurate manual image annotations. A state-of-the-art UDA framework, termed DAFormer, is applied to the synthetic source domain data with full annotations and real-world target domain data with no or partial annotations. The synthetic data set in this study is designed to correlate with real-world data by incorporating the relevant design standards and practices into the modeling step. Compared with the source-only supervised learning approach (which performed poorly on real-world data), the UDA improved the performance to a level close to the supervised learning that used real-world data with manual annotations (the Intersection over Union (IoU) difference is only 1.03%). Furthermore, the UDA approach outperformed the supervised learning that used target domain data if the small amount of annotated target domain data is mixed with the synthetic source domain data to guide the network's learning of patterns that only exist in the real-world environment (the IoU improvement was 5.03%). The UDA approach presented in this study facilitates the applications of DL-based visual recognition algorithms to bridge inspection tasks with limited manual effort.

Unsupervised Domain Adaptation Depth Estimation Based on Self-attention Mechanism and Edge Consistency Constraints

Attention-based Cross-Layer Domain Alignment for Unsupervised Domain Adaptation

Unsupervised Domain Adaptation Approach for Vision-Based Semantic Understanding of Bridge Inspection Scenes Without Manual Annotations

Unsupervised Domain Adaptation for Semantic Segmentation via Low-level Edge Information Transfer

Style Adaptation for Domain-adaptive Semantic Segmentation

Learning Feature Decomposition for Domain Adaptive Monocular Depth Estimation

Self-Supervised Learning of Domain Invariant Features for Depth Estimation

Learning Domain Invariant Features for Unsupervised Indoor Depth Estimation Adaptation

Learn to Adapt for Self-Supervised Monocular Depth Estimation

Deep Unsupervised Convolutional Domain Adaptation

Dynamic Instance Domain Adaptation

Self-Supervised Boundary Point Prediction Task for Point Cloud Domain Adaptation

Learning Depth from Monocular Videos Using Synthetic Data: A Temporally-Consistent Domain Adaptation Approach

Unsupervised Domain Adaptation via Style-Aware Self-intermediate Domain

Deep Adversarial Attention Alignment for Unsupervised Domain Adaptation: the Benefit of Target Expectation Maximization

Learning Depth from Monocular Videos Using Synthetic Data: A Temporally-Consistent Domain Adaptation Approach

Unsupervised Domain Adaptation for Semantic Segmentation Via Self-Supervision

Multi-Scale Depth-Aware Unsupervised Domain Adaption in Semantic Segmentation.

Deep Unsupervised Domain Adaptation: A Review of Recent Advances and Perspectives

Adversarial Unsupervised Domain Adaptation for 3D Semantic Segmentation with 2D Image Fusion of Dense Depth

Energy-constrained Self-training for Unsupervised Domain Adaptation