Abstract:Deep learning-based (DL) visual recognition algorithms are widely investigated to enhance the accuracy, efficiency, and objectivity of the bridge inspection process, which is largely manual today. These algorithms typically require a large amount of training data, which consists of images and corresponding annotations. The manual preparation of such data sets is time-consuming, and more automated data generation approaches that are aided by synthetic environments suffer from domain gaps, which result in poor performance in real-world tasks. This study investigates an unsupervised domain adaptation (UDA) approach for visual recognition in bridge inspection scenes to reduce and eventually eliminate the need for time-consuming and inaccurate manual image annotations. A state-of-the-art UDA framework, termed DAFormer, is applied to the synthetic source domain data with full annotations and real-world target domain data with no or partial annotations. The synthetic data set in this study is designed to correlate with real-world data by incorporating the relevant design standards and practices into the modeling step. Compared with the source-only supervised learning approach (which performed poorly on real-world data), the UDA improved the performance to a level close to the supervised learning that used real-world data with manual annotations (the Intersection over Union (IoU) difference is only 1.03%). Furthermore, the UDA approach outperformed the supervised learning that used target domain data if the small amount of annotated target domain data is mixed with the synthetic source domain data to guide the network's learning of patterns that only exist in the real-world environment (the IoU improvement was 5.03%). The UDA approach presented in this study facilitates the applications of DL-based visual recognition algorithms to bridge inspection tasks with limited manual effort.

VisDA: A Synthetic-to-Real Benchmark for Visual Domain Adaptation.

VisDA: The Visual Domain Adaptation Challenge

A Review of Single-Source Deep Unsupervised Visual Domain Adaptation

Unsupervised Domain Adaptation Approach for Vision-Based Semantic Understanding of Bridge Inspection Scenes Without Manual Annotations

VisDA-2021 Competition Universal Domain Adaptation to Improve Performance on Out-of-Distribution Data

A New Benchmark: on the Utility of Synthetic Data with Blender for Bare Supervised Learning and Downstream Domain Adaptation

Multi-Source Domain Adaptation and Semi-Supervised Domain Adaptation with Focus on Visual Domain Adaptation Challenge 2019

Enhancing Visual Domain Adaptation with Source Preparation

An Introduction to Domain Adaptive Object Detection from Synthesis to Reality

SKADA-Bench: Benchmarking Unsupervised Domain Adaptation Methods with Realistic Validation

DomainVerse: A Benchmark Towards Real-World Distribution Shifts For Tuning-Free Adaptive Domain Generalization

Synthetic-to-Real Domain Adaptation for Action Recognition: A Dataset and Baseline Performances

Attention-based Adversarial Partial Domain Adaptation

Can domain adaptation make object recognition work for everyone?

Learning multiple visual domains with residual adapters

Synthetic Data with Global-Local Level for Adversarial-based Domain Adaptation

Domain Adaptation Through Task Distillation

Unsupervised Domain Adaptation: from Simulation Engine to the RealWorld

Domain Adaptive Imitation Learning with Visual Observation

Deep visual domain adaptation: A survey

Deep Domain Adaptation: A Sim2Real Neural Approach for Improving Eye-Tracking Systems