Abstract:Test-time adaptation (TTA) aims to adapt a model, initially trained on training data, to test data with potential distribution shifts. Most existing TTA methods focus on classification problems. The pronounced success of classification might lead numerous newcomers and engineers to assume that classic TTA techniques can be directly applied to the more challenging task of semantic segmentation. However, this belief is still an open question. In this paper, we investigate the applicability of existing classic TTA strategies in semantic segmentation. Our comprehensive results have led to three key observations. First, the classic normalization updating strategy only brings slight performance improvement, and in some cases, it might even adversely affect the results. Even with the application of advanced distribution estimation techniques like batch renormalization, the problem remains unresolved. Second, although the teacher-student scheme does enhance the training stability for segmentation TTA in the presence of noisy pseudo-labels and temporal correlation, it cannot directly result in performance improvement compared to the original model without TTA under complex data distribution. Third, segmentation TTA suffers a severe long-tailed class-imbalance problem, which is substantially more complex than that in TTA for classification. This long-tailed challenge negatively affects segmentation TTA performance, even when the accuracy of pseudo-labels is high. Besides those observations, we find that visual prompt tuning (VisPT) is promising in segmentation TTA and propose a novel method named TTAP. The outstanding performance of TTAP has also been verified. We hope the community can give more attention to this challenging, yet important, segmentation TTA task in the future. The source code is available at: \textit{<a class="link-external link-https" href="https://github.com/ycarobot/TTAP" rel="external noopener nofollow">this https URL</a>

UPL-TTA: Uncertainty-Aware Pseudo Label Guided Fully Test Time Adaptation for Fetal Brain Segmentation

UPL-SFDA: Uncertainty-aware Pseudo Label Guided Source-Free Domain Adaptation for Medical Image Segmentation

DLTTA: Dynamic Learning Rate for Test-time Adaptation on Cross-domain Medical Images

Single Image Test-Time Adaptation for Segmentation

SATTA: Semantic-Aware Test-Time Adaptation for Cross-Domain Medical Image Segmentation

Pay Attention to the Atlas: Atlas-Guided Test-Time Adaptation Method for Robust 3D Medical Image Segmentation

Enhancing Test Time Adaptation with Few-shot Guidance

From Question to Exploration: Test-Time Adaptation in Semantic Segmentation?

Augmented Contrastive Clustering with Uncertainty-Aware Prototyping for Time Series Test Time Adaptation

Feature Alignment and Uniformity for Test Time Adaptation

Towards Clinician-Preferred Segmentation: Leveraging Human-in-the-Loop for Test Time Adaptation in Medical Image Segmentation

Fully Test-Time Adaptation for Image Segmentation

Test-time adaptation for geospatial point cloud semantic segmentation with distinct domain shifts

Uncertainty-Calibrated Test-Time Model Adaptation without Forgetting

Generalized Robust Test-Time Adaptation in Continuous Dynamic Scenarios

Reliable Spatial-Temporal Voxels For Multi-Modal Test-Time Adaptation

Bi-TTA: Bidirectional Test-Time Adapter for Remote Physiological Measurement

Few Clicks Suffice: Active Test-Time Adaptation for Semantic Segmentation

Exploring Test-Time Adaptation for Object Detection in Continually Changing Environments

MM-TTA: Multi-Modal Test-Time Adaptation for 3D Semantic Segmentation

Test-time augmentation-based active learning and self-training for label-efficient segmentation