Abstract:Unsupervised domain adaptation semantic segmentation (UDASS) methods aim to learn domain-invariant information for alleviating the distribution shift problem between the source and target domains. However, ignoring the learning of domain-specific information that is label-related may limit the class discriminability on the target domain. We argue that a good representation for the UDASS task not only contains domain-invariant information but also preserves label-related domain-specific information. In this paper, a novel frequency spectrum domain adaptation approach via meta-learning (ML-FSDA) is proposed to achieve this goal for improving the class discriminability and generalization ability. ML-FSDA contains a frequency-spectrum meta-learning framework (FMF) and a class-aware domain-specific memory bank (CDMB). Specifically, first, inspired by the observation that the high-frequency component is consistent across different domains while the low-frequency component is much more domain-specific, the FMF aims to respectively learn label-related domain-specific and domain-invariant information from low-frequency and high-frequency images in a unified framework via the meta-learning strategy. Second, the CDMB is designed to preserve the label-related domain-specific information of each class in an external memory bank while the CDMB is updated in every iteration of the meta-training stage. Finally, the CDMB is utilized to embed the label-related domain-specific information into domain-invariant information at the class level during the meta-testing stage to enhance the class discriminability on the target domain. Extensive experiments demonstrate the effectiveness of ML-FSDA on two challenging cross-domain semantic segmentation benchmarks. Notably, for the GTA5 to Cityscapes task and the SYNTHIA to Cityscapes task, the proposed ML-FSDA achieves superior performance with 77.3% mIoU and 68.8% mIoU, respectively. The source code is released at https://github.com/seabearlmx/FSL.

CMFST : Class-based Multi-scale Fusion Self-training for Adapting Semantic Segmentation

Enhanced Multi-Scale Feature Adaptive Fusion Sparse Convolutional Network for Large-Scale Scenes Semantic Segmentation

A Self-Training Framework Based on Multi-Scale Attention Fusion for Weakly Supervised Semantic Segmentation

Unsupervised Domain Adaptation Multi-Level Adversarial Network for Semantic Segmentation Based on Multi-Modal Features

A Crossmodal Multiscale Fusion Network for Semantic Segmentation of Remote Sensing Data

Hard-aware Instance Adaptive Self-training for Unsupervised Cross-domain Semantic Segmentation

Contrastive Learning and Self-Training for Unsupervised Domain Adaptation in Semantic Segmentation

Fully Convolutional Adaptation Networks for Semantic Segmentation

Multi-Scale Depth-Aware Unsupervised Domain Adaption in Semantic Segmentation.

Multi-Source Domain Adaptation with Collaborative Learning for Semantic Segmentation

Preserving Label-Related Domain-Specific Information for Cross-Domain Semantic Segmentation

Instance Adaptive Self-training for Unsupervised Domain Adaptation

Self-Supervised Model Adaptation for Multimodal Semantic Segmentation

ASFNet: Adaptive Multiscale Segmentation Fusion Network for Real‐time Semantic Segmentation

CAFA: Cross-Modal Attentive Feature Alignment for Cross-Domain Urban Scene Segmentation

MFEAFN: Multi-scale feature enhanced adaptive fusion network for image semantic segmentation

Improving Semantic Segmentation via Efficient Self-Training

MFAFNet: A Lightweight and Efficient Network with Multi-Level Feature Adaptive Fusion for Real-Time Semantic Segmentation

Based on cross-scale fusion attention mechanism network for semantic segmentation for street scenes

A Multi-Grained Unsupervised Domain Adaptation Approach for Semantic Segmentation

Unsupervised Semantic Segmentation with Feature Fusion