Abstract:Test-time adaptation (TTA) seeks to tackle potential distribution shifts between training and test data by adapting a given model w.r.t. any test sample. Although recent TTA has shown promising performance, we still face two key challenges: 1) prior methods perform backpropagation for each test sample, resulting in unbearable optimization costs to many applications; 2) while existing TTA can significantly improve the test performance on out-of-distribution data, they often suffer from severe performance degradation on in-distribution data after TTA (known as forgetting). To this end, we have proposed an Efficient Anti-Forgetting Test-Time Adaptation (EATA) method which develops an active sample selection criterion to identify reliable and non-redundant samples for test-time entropy minimization. To alleviate forgetting, EATA introduces a Fisher regularizer estimated from test samples to constrain important model parameters from drastic changes. However, in EATA, the adopted entropy loss consistently assigns higher confidence to predictions even for samples that are underlying uncertain, leading to overconfident predictions. To tackle this, we further propose EATA with Calibration (EATA-C) to separately exploit the reducible model uncertainty and the inherent data uncertainty for calibrated TTA. Specifically, we measure the model uncertainty by the divergence between predictions from the full network and its sub-networks, on which we propose a divergence loss to encourage consistent predictions instead of overconfident ones. To further recalibrate prediction confidence, we utilize the disagreement among predicted labels as an indicator of the data uncertainty, and then devise a min-max entropy regularizer to selectively increase and decrease prediction confidence for different samples. Experiments on image classification and semantic segmentation verify the effectiveness of our methods.

Augmented Contrastive Clustering with Uncertainty-Aware Prototyping for Time Series Test Time Adaptation

UPL-TTA: Uncertainty-Aware Pseudo Label Guided Fully Test Time Adaptation for Fetal Brain Segmentation

Test-time Adaptation Meets Image Enhancement: Improving Accuracy via Uncertainty-aware Logit Switching

Generalized Robust Test-Time Adaptation in Continuous Dynamic Scenarios

Uncertainty-Calibrated Test-Time Model Adaptation without Forgetting

Test-Time Adaptation via Self-Training with Nearest Neighbor Information

Feature Augmentation based Test-Time Adaptation

Parametric Augmentation for Time Series Contrastive Learning

Test Time Learning for Time Series Forecasting

Robust Test-Time Adaptation in Dynamic Scenarios

Time Series Contrastive Learning with Information-Aware Augmentations

Confidence-based and sample-reweighted test-time adaptation

A Comprehensive Survey on Test-Time Adaptation under Distribution Shifts

Test-Time Adaptation with Perturbation Consistency Learning

Anomaly Detection with Test Time Augmentation and Consistency Evaluation

Enhancing Test Time Adaptation with Few-shot Guidance

Revisiting Realistic Test-Time Training: Sequential Inference and Adaptation by Anchored Clustering Regularized Self-Training

Improving Entropy-Based Test-Time Adaptation from a Clustering View

UniTTA: Unified Benchmark and Versatile Framework Towards Realistic Test-Time Adaptation

TTVD: Towards a Geometric Framework for Test-Time Adaptation Based on Voronoi Diagram

Efficient Improvement of Classification Accuracy via Selective Test-Time Augmentation