Abstract:Test-time domain adaptation aims to adapt the model trained on source domains to unseen target domains using a few unlabeled images. Emerging research has shown that the label and domain information is separately embedded in the weight matrix and batch normalization (BN) layer. Previous works normally update the whole network naively without explicitly decoupling the knowledge between label and domain. As a result, it leads to knowledge interference and defective distribution adaptation. In this work, we propose to reduce such learning interference and elevate the domain knowledge learning by only manipulating the BN layer. However, the normalization step in BN is intrinsically unstable when the statistics are re-estimated from a few samples. We find that ambiguities can be greatly reduced when only updating the two affine parameters in BN while keeping the source domain statistics. To further enhance the domain knowledge extraction from unlabeled data, we construct an auxiliary branch with label-independent self-supervised learning (SSL) to provide supervision. Moreover, we propose a bi-level optimization based on meta-learning to enforce the alignment of two learning objectives of auxiliary and main branches. The goal is to use the auxiliary branch to adapt the domain and benefit main task for subsequent inference. Our method keeps the same computational cost at inference as the auxiliary branch can be thoroughly discarded after adaptation. Extensive experiments show that our method outperforms the prior works on five WILDS real-world domain shift datasets. Our method can also be integrated with methods with label-dependent optimization to further push the performance boundary. Our code is available at <a class="link-external link-https" href="https://github.com/ynanwu/MABN" rel="external noopener nofollow">this https URL</a>.

MixTBN: A Fully Test-Time Adaptation Method for Visual Reinforcement Learning on Robotic Manipulation

Un-Mixing Test-Time Normalization Statistics: Combatting Label Temporal Correlation

Generalization of Reinforcement Learning with Policy-Aware Adversarial Data Augmentation

An Efficient Generalizable Framework for Visuomotor Policies via Control-aware Augmentation and Privilege-guided Distillation

Resilient Practical Test-Time Adaptation: Soft Batch Normalization Alignment and Entropy-driven Memory Bank

Robust Policies via Mid-Level Visual Representations: An Experimental Study in Manipulation and Navigation

Towards Real-World Test-Time Adaptation: Tri-net Self-Training with Balanced Normalization

MENTOR: Mixture-of-Experts Network with Task-Oriented Perturbation for Visual Reinforcement Learning

MoVie: Visual Model-Based Policy Adaptation for View Generalization

Single Episode Policy Transfer in Reinforcement Learning

Meta-TTT: A Meta-learning Minimax Framework For Test-Time Training

Imagined Value Gradients: Model-Based Policy Optimization with Transferable Latent Dynamics Models

MixNorm: Test-Time Adaptation Through Online Normalization Estimation

Unraveling Batch Normalization for Realistic Test-Time Adaptation

Learning to combine primitive skills: A step towards versatile robotic manipulation

Test-Time Domain Adaptation by Learning Domain-Aware Batch Normalization

Domain Adaptation of Visual Policies with a Single Demonstration

Learning to Manipulate Anywhere: A Visual Generalizable Framework For Reinforcement Learning

Normalization Enhances Generalization in Visual Reinforcement Learning.

Invariant Transform Experience Replay: Data Augmentation for Deep Reinforcement Learning.