Abstract:Cross domain object detection learns an object detector for an unlabeled target domain by transferring knowledge from an annotated source domain. Promising results have been achieved via Mean Teacher, however, pseudo labeling which is the bottleneck of mutual learning remains to be further explored. In this study, we find that confidence misalignment of the predictions, including category-level overconfidence, instance-level task confidence inconsistency, and image-level confidence misfocusing, leading to the injection of noisy pseudo label in the training process, will bring suboptimal performance on the target domain. To tackle this issue, we present a novel general framework termed Multi-Granularity Confidence Alignment Mean Teacher (MGCAMT) for cross domain object detection, which alleviates confidence misalignment across category-, instance-, and image-levels simultaneously to obtain high quality pseudo supervision for better teacher-student learning. Specifically, to align confidence with accuracy at category level, we propose Classification Confidence Alignment (CCA) to model category uncertainty based on Evidential Deep Learning (EDL) and filter out the category incorrect labels via an uncertainty-aware selection strategy. Furthermore, to mitigate the instance-level misalignment between classification and localization, we design Task Confidence Alignment (TCA) to enhance the interaction between the two task branches and allow each classification feature to adaptively locate the optimal feature for the regression. Finally, we develop imagery Focusing Confidence Alignment (FCA) adopting another way of pseudo label learning, i.e., we use the original outputs from the Mean Teacher network for supervised learning without label assignment to concentrate on holistic information in the target image. These three procedures benefit from each other from a cooperative learning perspective.

Multilevel Knowledge Transfer for Cross-Domain Object Detection

Joint Feature-Level And Pixel-Level Domain Adaption For Object Detection In The Wild

Progressive Cross-Domain Knowledge Distillation for Efficient Unsupervised Domain Adaptive Object Detection

Domain adaptive object detection with model-agnostic knowledge transferring

Multi-source unsupervised domain adaptation for object detection

Multi-Level Domain Adaptive Learning For Cross-Domain Detection

Incremental learning based multi-domain adaptation for object detection

Cross-Domain Remote Sensing Image Object Detection Based on Multi-Scale Domain Adaptive Teacher Network

Unsupervised Domain Adaptation for Object Detection Through Mixed-Domain and Co-Training Learning

Reliable hybrid knowledge distillation for multi-source domain adaptive object detection

Domain Adaptive Object Detection via Balancing Between Self-Training and Adversarial Learning

Semantic Consistency Knowledge Transfer for Unsupervised Cross Domain Object Detection

Cross-domain Object Detection by Local to Global Object-Aware Feature Alignment

Multidomain Object Detection Framework Using Feature Domain Knowledge Distillation.

Domain Adaptive YOLO for One-Stage Cross-Domain Detection

Target-Relevant Knowledge Preservation for Multi-Source Domain Adaptive Object Detection

Spatial Alignment for Unsupervised Domain Adaptive Single-Stage Object Detection

Cross Domain Object Detection via Multi-Granularity Confidence Alignment based Mean Teacher

Domain-Invariant Proposals Based on a Balanced Domain Classifier for Object Detection

Domain Adaptive Faster R-CNN for Object Detection in the Wild

Dual-Level Adaptive and Discriminative Knowledge Transfer for Cross-Domain Recognition