Abstract:Test-time adaptation (TTA) seeks to tackle potential distribution shifts between training and test data by adapting a given model w.r.t. any test sample. Although recent TTA has shown promising performance, we still face two key challenges: 1) prior methods perform backpropagation for each test sample, resulting in unbearable optimization costs to many applications; 2) while existing TTA can significantly improve the test performance on out-of-distribution data, they often suffer from severe performance degradation on in-distribution data after TTA (known as forgetting). To this end, we have proposed an Efficient Anti-Forgetting Test-Time Adaptation (EATA) method which develops an active sample selection criterion to identify reliable and non-redundant samples for test-time entropy minimization. To alleviate forgetting, EATA introduces a Fisher regularizer estimated from test samples to constrain important model parameters from drastic changes. However, in EATA, the adopted entropy loss consistently assigns higher confidence to predictions even for samples that are underlying uncertain, leading to overconfident predictions. To tackle this, we further propose EATA with Calibration (EATA-C) to separately exploit the reducible model uncertainty and the inherent data uncertainty for calibrated TTA. Specifically, we measure the model uncertainty by the divergence between predictions from the full network and its sub-networks, on which we propose a divergence loss to encourage consistent predictions instead of overconfident ones. To further recalibrate prediction confidence, we utilize the disagreement among predicted labels as an indicator of the data uncertainty, and then devise a min-max entropy regularizer to selectively increase and decrease prediction confidence for different samples. Experiments on image classification and semantic segmentation verify the effectiveness of our methods.

Noise-Robust Continual Test-Time Domain Adaptation

A Versatile Framework for Continual Test-Time Domain Adaptation: Balancing Discriminability and Generalizability

Continual Test-time Adaptation for End-to-end Speech Recognition on Noisy Speech

NC-TTT: A Noise Contrastive Approach for Test-Time Training

Controllable Continual Test-Time Adaptation

Generalized Robust Test-Time Adaptation in Continuous Dynamic Scenarios

Analytic Continual Test-Time Adaptation for Multi-Modality Corruption

Advancing Test-Time Adaptation in Wild Acoustic Test Settings

Feature Alignment and Uniformity for Test Time Adaptation

Towards Test Time Adaptation Via Calibrated Entropy Minimization

Advancing Model Generalization in Continuous Cyclic Test-Time Adaptation with Matrix Perturbation Noise

Towards Test Time Domain Adaptation Via Negative Label Smoothing

Enhancing Test Time Adaptation with Few-shot Guidance

Confidence-based and sample-reweighted test-time adaptation

SoTTA: Robust Test-Time Adaptation on Noisy Data Streams

Robust Mean Teacher for Continual and Gradual Test-Time Adaptation

TTAQ: Towards Stable Post-training Quantization in Continuous Domain Adaptation

Multiple Consistency-guided Test-Time Adaptation for Contrastive Audio-Language Models with Unlabeled Audio

Continual-MAE: Adaptive Distribution Masked Autoencoders for Continual Test-Time Adaptation

Uncertainty-Calibrated Test-Time Model Adaptation without Forgetting

Robust gradient aware and reliable entropy minimization for stable test-time adaptation in dynamic scenarios