Abstract:The prevalence of domain adaptive semantic segmentation has prompted concerns regarding source domain data leakage, where private information from the source domain could inadvertently be exposed in the target domain. To circumvent the requirement for source data, source-free domain adaptation has emerged as a viable solution that leverages self-training methods to pseudo-label high-confidence regions and adapt the model to the target data. However, the confidence scores obtained are often highly biased due to over-confidence and class-imbalance issues, which render both model selection and optimization problematic. In this paper, we propose a novel calibration-guided source-free domain adaptive semantic segmentation (Cal-SFDA) framework. The core idea is to estimate the expected calibration error (ECE) from the segmentation predictions, serving as a strong indicator of the model's generalization capability to the unlabeled target domain. The estimated ECE scores, in turn, assist the model training and fair selection in both source training and target adaptation stages. During model pre-training on the source domain, we ensure the differentiability of the ECE objective by leveraging the LogSumExp trick and using ECE scores to select the best source checkpoints for adaptation. To enable ECE estimation on the target domain without requiring labels, we train a value net for ECE estimation and apply statistic warm-up on its BatchNorm layers for stability. The estimated ECE scores assist in determining the reliability of prediction and enable class-balanced pseudo-labeling by positively guiding the adaptation progress and inhibiting potential error accumulation. Extensive experiments on two widely-used synthetic-to-real transfer tasks show that the proposed approach surpasses previous state-of-the-art by up to 5.25% of mIoU with fair model selection criteria.

Confidence Calibration for Domain Generalization under Covariate Shift

Transferable Calibration with Lower Bias and Variance in Domain Adaptation.

Bridging Multicalibration and Out-of-distribution Generalization Beyond Covariate Shift

Post-hoc Uncertainty Calibration for Domain Drift Scenarios

Robust Calibration with Multi-domain Temperature Scaling

Unsupervised Calibration under Covariate Shift

Domain-adaptive and Subgroup-specific Cascaded Temperature Regression for Out-of-distribution Calibration

Estimating Model Performance under Domain Shifts with Class-Specific Confidence Scores

Learning Calibrated Uncertainties for Domain Shift: a Distributionally Robust Learning Approach

Privacy Preserving Recalibration under Domain Shift

GradCa: Generalizing to Unseen Domains Via Gradient Calibration

Calibration of Network Confidence for Unsupervised Domain Adaptation Using Estimated Accuracy

Mitigating Both Covariate and Conditional Shift for Domain Generalization

Algorithmic Fairness Generalization under Covariate and Dependence Shifts Simultaneously

Test-time Batch Statistics Calibration for Covariate Shift

Towards Improving Calibration in Object Detection Under Domain Shift

Field-aware Calibration: A Simple and Empirically Strong Method for Reliable Probabilistic Predictions

Deep Distributionally Robust Learning for Calibrated Uncertainties under Domain Shift

Cal-SFDA: Source-Free Domain-adaptive Semantic Segmentation with Differentiable Expected Calibration Error

Confidence Calibration for Systems with Cascaded Predictive Modules

Confidence-Aware Multi-Field Model Calibration