Abstract:Deep neural networks (DNNs) have proven their capabilities in many areas in the past years, such as robotics, or automated driving, enabling technological breakthroughs. DNNs play a significant role in environment perception for the challenging application of automated driving and are employed for tasks such as detection, semantic segmentation, and sensor fusion. Despite this progress and tremendous research efforts, several issues still need to be addressed that limit the applicability of DNNs in automated driving. The bad generalization of DNNs to new, unseen domains is a major problem on the way to a safe, large-scale application, because manual annotation of new domains is costly, particularly for semantic segmentation. For this reason, methods are required to adapt DNNs to new domains without labeling effort. The task, which these methods aim to solve is termed unsupervised domain adaptation (UDA). While several different domain shifts can challenge DNNs, the shift between synthetic and real data is of particular importance for automated driving, as it allows the use of simulation environments for DNN training. In this work, we present an overview of the current state of the art in this field of research. We categorize and explain the different approaches for UDA. The number of considered publications is larger than any other survey on this topic. The scope of this survey goes far beyond the description of the UDA state-of-the-art. Based on our large data and knowledge base, we present a quantitative comparison of the approaches and use the observations to point out the latest trends in this field. In the following, we conduct a critical analysis of the state-of-the-art and highlight promising future research directions. With this survey, we aim to facilitate UDA research further and encourage scientists to exploit novel research directions to generalize DNNs better.

Neural Unsupervised Domain Adaptation in NLP---A Survey

Transfer Learning and Deep Domain Adaptation

A Survey of Unsupervised Deep Domain Adaptation

Deep Unsupervised Domain Adaptation: A Review of Recent Advances and Perspectives

Unsupervised Domain Adaptation: from Simulation Engine to the RealWorld

A Survey of Domain Adaptation for Neural Machine Translation.

Domain Adaptation and Multi-Domain Adaptation for Neural Machine Translation: A Survey

On the Domain Adaptation and Generalization of Pretrained Language Models: A Survey

A survey on domain adaptation theory: learning bounds and theoretical guarantees

Multi-source Domain Adaptation in the Deep Learning Era: A Systematic Survey

Deep visual domain adaptation: A survey

Unsupervised Domain Adaptation of Object Detectors: A Survey

Survey on Unsupervised Domain Adaptation for Semantic Segmentation for Visual Perception in Automated Driving

Domain Adaptation for Visual Applications: A Comprehensive Survey

More is Better: Deep Domain Adaptation with Multiple Sources

Open-world Domain Adaptation and Generalization

An Empirical Study of Domain Adaptation for Unsupervised Neural Machine Translation

Unsupervised Domain Adaptation for Semantic Image Segmentation: a Comprehensive Survey

Unsupervised Domain Adaptation by Backpropagation

Domain Generalization through Meta-Learning: A Survey

A Comprehensive Survey on Source-Free Domain Adaptation