Abstract:As one of the fundamental functions of autonomous driving system, freespace detection aims at classifying each pixel of the image captured by the camera as drivable or non-drivable. Current works of freespace detection heavily rely on large amount of densely labeled training data for accuracy and robustness, which is time-consuming and laborious to collect and annotate. To the best of our knowledge, we are the first work to explore unsupervised domain adaptation for freespace detection to alleviate the data limitation problem with synthetic data. We develop a cross-modality domain adaptation framework which exploits both RGB images and surface normal maps generated from depth images. A Collaborative Cross Guidance (CCG) module is proposed to leverage the context information of one modality to guide the other modality in a cross manner, thus realizing inter-modality intra-domain complement. To better bridge the domain gap between source domain (synthetic data) and target domain (real-world data), we also propose a Selective Feature Alignment (SFA) module which only aligns the features of consistent foreground area between the two domains, thus realizing inter-domain intra-modality adaptation. Extensive experiments are conducted by adapting three different synthetic datasets to one real-world dataset for freespace detection respectively. Our method performs closely to fully supervised freespace detection methods (93.08 v.s. 97.50 F1 score) and outperforms other general unsupervised domain adaptation methods for semantic segmentation with large margins, which shows the promising potential of domain adaptation for freespace detection.

Uncertainty-Aware and Class-Balanced Domain Adaptation for Object Detection in Driving Scenes

Uncertainty-Aware Model Adaptation for Unsupervised Cross-Domain Object Detection

Multi-View Domain Adaptive Object Detection on Camera Networks.

An Object Detection Method Based on Feature Uncertainty Domain Adaptation for Autonomous Driving

Joint Feature-Level And Pixel-Level Domain Adaption For Object Detection In The Wild

Uncertainty-Aware Unsupervised Domain Adaptation in Object Detection

Multiscale Attention-Based Subdomain Dynamic Adaptation for Cross-Domain Scene Classification

Class-unbalanced Domain Adaptation for Object Detection Via Dynamic Weighting Mechanism

Unsupervised Domain Adaptation for Object Detection Through Mixed-Domain and Co-Training Learning

Domain Adaptive Object Detection via Balancing Between Self-Training and Adversarial Learning

Joint Distribution Alignment via Adversarial Learning for Domain Adaptive Object Detection

Cross-domain Learning Using Optimized Pseudo Labels: Toward Adaptive Car Detection in Different Weather Conditions and Urban Cities

Cross-Modality Domain Adaptation for Freespace Detection: A Simple Yet Effective Baseline

Cross-domain Adaptive Object Detection Based on Refined Knowledge Transfer and Mined Guidance in Autonomous Vehicles

Uncertainty-Aware Consistency Regularization for Cross-Domain Semantic Segmentation

Class-aware Memory Guided Unbiased Weighting for Universal Domain Adaptive Object Detection

Cross-domain Object Detection through Coarse-to-Fine Feature Adaptation

Spatial Alignment for Unsupervised Domain Adaptive Single-Stage Object Detection

Uncertainty-Aware Source-Free Domain Adaptive Semantic Segmentation.

Progressive Domain Adaptation for Object Detection

Domain Adaptation based Object Detection for Autonomous Driving in Foggy and Rainy Weather