Abstract:Test-time adaptation (TTA) seeks to tackle potential distribution shifts between training and test data by adapting a given model w.r.t. any test sample. Although recent TTA has shown promising performance, we still face two key challenges: 1) prior methods perform backpropagation for each test sample, resulting in unbearable optimization costs to many applications; 2) while existing TTA can significantly improve the test performance on out-of-distribution data, they often suffer from severe performance degradation on in-distribution data after TTA (known as forgetting). To this end, we have proposed an Efficient Anti-Forgetting Test-Time Adaptation (EATA) method which develops an active sample selection criterion to identify reliable and non-redundant samples for test-time entropy minimization. To alleviate forgetting, EATA introduces a Fisher regularizer estimated from test samples to constrain important model parameters from drastic changes. However, in EATA, the adopted entropy loss consistently assigns higher confidence to predictions even for samples that are underlying uncertain, leading to overconfident predictions. To tackle this, we further propose EATA with Calibration (EATA-C) to separately exploit the reducible model uncertainty and the inherent data uncertainty for calibrated TTA. Specifically, we measure the model uncertainty by the divergence between predictions from the full network and its sub-networks, on which we propose a divergence loss to encourage consistent predictions instead of overconfident ones. To further recalibrate prediction confidence, we utilize the disagreement among predicted labels as an indicator of the data uncertainty, and then devise a min-max entropy regularizer to selectively increase and decrease prediction confidence for different samples. Experiments on image classification and semantic segmentation verify the effectiveness of our methods.

Backpropagation-free Network for 3D Test-time Adaptation

Test-Time Adaptation of 3D Point Clouds via Denoising Diffusion Models

Test-Time Adaptation in Point Clouds: Leveraging Sampling Variation with Weight Averaging

Better Regression Makes Better Test-time Adaptive 3D Object Detection

Efficient Test-Time Model Adaptation without Forgetting

MM-TTA: Multi-Modal Test-Time Adaptation for 3D Semantic Segmentation

Distribution Alignment for Fully Test-Time Adaptation with Dynamic Online Data Streams

Test-time Adaptation in the Dynamic World with Compound Domain Knowledge Management

EcoTTA: Memory-Efficient Continual Test-time Adaptation via Self-distilled Regularization

Single Image Test-Time Adaptation for Segmentation

Fully Test-Time Adaptation for Monocular 3D Object Detection

Test-Time Adaptation for Depth Completion

TTT-KD: Test-Time Training for 3D Semantic Segmentation through Knowledge Distillation from Foundation Models

Enhancing Test Time Adaptation with Few-shot Guidance

Unraveling Batch Normalization for Realistic Test-Time Adaptation

Multi-Modal Continual Test-Time Adaptation for 3D Semantic Segmentation

TTVD: Towards a Geometric Framework for Test-Time Adaptation Based on Voronoi Diagram

Test-Time Adaptation for Point Cloud Upsampling Using Meta-Learning

Uncertainty-Calibrated Test-Time Model Adaptation without Forgetting

Confidence-based and sample-reweighted test-time adaptation

Universal Test-time Adaptation through Weight Ensembling, Diversity Weighting, and Prior Correction