Abstract:Accurate diagnosis of pediatric posterior fossa tumors (PFTs) is critical for saving lives; however, the limited number of specialists makes accurate diagnostics scarce. To make the diagnosis of PFTs accurate, automatic, and noninvasive, scholars have proposed employing deep neural networks (DNNs) to predict tumor types using magnetic resonance imaging data. Advanced methods primarily focus on fine-tuning DNNs pre-trained on large-scale datasets of natural images, e.g., ImageNet. However, the existing methods overlook the priors of human experts. Human experts typically recheck whether images predicted as a particular class are similar to those predicted as the same class to ensure prediction consistency. Therefore, the predicted results of an intelligent system should be consistent. Inspired by the rechecking process, we propose a novel learning paradigm called Co nsistency ca libration (Coca). Within the Coca framework, the output predicted by DNNs is guided by two objective functions: (i) the task-specific objective of making the predicted results the same as the groundtruth, and (ii) an auxiliary objective of rechecking the prediction consistency. Coca is developed by defining the inconsistency for each sample by inconsistent risks: the auxiliary risk is small (large), but the task-specific risk is large (small). Building on the inconsistency definition, Coca identifies inconsistencies for each sample using an adversarial attack. Subsequently, these inconsistencies are leveraged to tune DNNs in an adversarial training manner for consistency calibration. To verify the efficacy of Coca, we conduct comprehensive experiments using a large-scale PBT dataset, and the results show that Coca significantly outperforms state-of-the-art methods. Moreover, Coca has improved performance over human experts as demonstrated by expert-level diagnostic performance in real-world PBT scenarios for the first time.

A Field of Experts Prior for Adapting Neural Networks at Test Time

Test-Time Adaptable Neural Networks for Robust Medical Image Segmentation

Pay Attention to the Atlas: Atlas-Guided Test-Time Adaptation Method for Robust 3D Medical Image Segmentation

Test-Time Adaptation with Shape Moments for Image Segmentation

DG-TTA: Out-of-domain medical image segmentation through Domain Generalization and Test-Time Adaptation

Single Image Test-Time Adaptation for Segmentation

UPL-TTA: Uncertainty-Aware Pseudo Label Guided Fully Test Time Adaptation for Fetal Brain Segmentation

Towards Clinician-Preferred Segmentation: Leveraging Human-in-the-Loop for Test Time Adaptation in Medical Image Segmentation

Expert-level diagnosis of pediatric posterior fossa tumors via consistency calibration

DLTTA: Dynamic Learning Rate for Test-time Adaptation on Cross-domain Medical Images

Edge-Guided Output Adaptor: Highly Efficient Adaptation Module for Cross-Vendor Medical Image Segmentation.

Improving Calibration and Out-of-Distribution Detection in Deep Models for Medical Image Segmentation

Calibrated Diverse Ensemble Entropy Minimization for Robust Test-Time Adaptation in Prostate Cancer Detection

Domain-Specific Block Selection and Paired-View Pseudo-Labeling for Online Test-Time Adaptation

Test-Time Adaptation of 3D Point Clouds via Denoising Diffusion Models

Test-time augmentation for deep learning-based cell segmentation on microscopy images

CAFA: Class-Aware Feature Alignment for Test-Time Adaptation

Benchmarking Test-Time Adaptation against Distribution Shifts in Image Classification

SATTA: Semantic-Aware Test-Time Adaptation for Cross-Domain Medical Image Segmentation

Segmentation by Test-Time Optimization (TTO) for CBCT-based Adaptive Radiation Therapy

BayTTA: Uncertainty-aware medical image classification with optimized test-time augmentation using Bayesian model averaging