Abstract:Background and Objective: Deep learning models often suffer from performance degradations when deployed in real clinical environments due to appearance shifts between training and testing images. Most extant methods use training-time adaptation , which almost require target domain samples in the training phase. However, these solutions are limited by the training process and cannot guarantee the accurate prediction of test samples with unforeseen appearance shifts. Further, it is impractical to collect target samples in advance. In this paper, we provide a general method of making existing segmentation models robust to samples with unknown appearance shifts when deployed in daily clinical practice. Methods: Our proposed test-time bi-directional adaptation framework combines two complementary strategies. First, our image-to-model (I2M) adaptation strategy adapts appearance-agnostic test images to the learned segmentation model using a novel plug-and-play statistical alignment style transfer module during testing. Second, our model-to-image (M2I) adaptation strategy adapts the learned segmentation model to test images with unknown appearance shifts. This strategy applies an augmented self-supervised learning module to fine-tune the learned model with proxy labels that it generates. This innovative procedure can be adaptively constrained using our novel proxy consistency criterion. This complementary I2M and M2I framework demonstrably achieves robust segmentation against unknown appearance shifts using existing deep-learning models. Results: Extensive experiments on 10 datasets containing fetal ultrasound, chest X-ray, and retinal fundus images demonstrate that our proposed method achieves promising robustness and efficiency in segmenting images with unknown appearance shifts. Conclusions: To address the appearance shift problem in clinically acquired medical images, we provide robust segmentation by using two complementary strategies. Our solution is general and amenable for deployment in clinical settings.

Test-Time Adaptation Via Orthogonal Meta-Learning for Medical Imaging

DLTTA: Dynamic Learning Rate for Test-time Adaptation on Cross-domain Medical Images

Test-time Bi-directional Adaptation between Image and Model for Robust Segmentation

Test-Time Adaptation for Point Cloud Upsampling Using Meta-Learning

An Optimization-Based Meta-Learning Model for MRI Reconstruction with Diverse Dataset

Selective Test-Time Adaptation for Unsupervised Anomaly Detection using Neural Implicit Representations

Meta-Registration: Learning Test-Time Optimization for Single-Pair Image Registration

Embracing the disharmony in medical imaging: A Simple and effective framework for domain adaptation

Boosting Few-Shot Learning with Disentangled Self-Supervised Learning and Meta-Learning for Medical Image Classification

MLFA: Toward Realistic Test Time Adaptive Object Detection by Multi-Level Feature Alignment

Towards Clinician-Preferred Segmentation: Leveraging Human-in-the-Loop for Test Time Adaptation in Medical Image Segmentation

Fully Test-Time Adaptation for Monocular 3D Object Detection

Model-based Synthetic Data-driven Learning (MOST-DL): Application in Single-shot T2 Mapping with Severe Head Motion Using Overlapping-echo Acquisition

Consecutive knowledge meta-adaptation learning for unsupervised medical diagnosis

Gradient Alignment Improves Test-Time Adaptation for Medical Image Segmentation

DG-TTA: Out-of-domain medical image segmentation through Domain Generalization and Test-Time Adaptation

Test-time Adaptation with Calibration of Medical Image Classification Nets for Label Distribution Shift

DBTN: An adaptive neural network for multiple-disease detection via imbalanced medical images distribution

Predicting Scores of Medical Imaging Segmentation Methods with Meta-Learning

Continual Active Learning for Efficient Adaptation of Machine Learning Models to Changing Image Acquisition