Abstract:Heavy rain significantly reduces image visibility, hindering tasks like autonomous driving and video surveillance. Many existing rain removal methods, while effective in light rain, falter under heavy rain due to their reliance on purely spatial features. Recognizing this challenge, we introduce the Wavelet-Spatial Dual Attention Transformer Framework (WSDformer). This innovative architecture adeptly captures both frequency and spatial characteristics, anchored by the wavelet-spatial dual attention (WSDA) mechanism. While the spatial attention zeroes in on intricate local details, the wavelet attention leverages wavelet decomposition to encompass diverse frequency information, augmenting the spatial representations. Furthermore, addressing the persistent issue of incomplete structural detail restoration, we integrate the PriorFormer Block (PFB). This unique module, underpinned by the Prior Fusion Attention (PFA), synergizes residual channel prior features with input features, thereby enhancing background structures and guiding precise rain feature extraction. To navigate the intrinsic constraints of U-shaped transformers, such as semantic discontinuities and subdued multi-scale interactions from skip connections, our Cross Interaction U-Shaped Transformer Network is introduced. This design empowers superior semantic layers to streamline the extraction of their lower-tier counterparts, optimizing network learning. Empirical analysis reveals our method's leading prowess across rainy image datasets and achieves state-of-the-art performance, with notable supremacy in heavy rainfall conditions. This superiority extends to diverse visual challenges and real-world rainy scenarios, affirming its broad applicability and robustness. The source code is available at https://github.com/Jiongze-Yu/WSDformer.

Comprehensive Augmented Domain Adaptation for Image Segmentation under Rainy Conditions

An Underwater Image Enhancement Model for Domain Adaptation

Domain Adaptation Transformer for Unsupervised Driving-Scene Segmentation in Adverse Conditions

Cross-domain attention-guided domain adaptive method for image real rain removal

Close the Loop: A Unified Bottom-Up and Top-Down Paradigm for Joint Image Deraining and Segmentation.

Rainy day image semantic segmentation based on two-stage progressive network

Rainy Night Scene Understanding with Near Scene Semantic Adaptation

Weather-aware autopilot: Domain generalization for point cloud semantic segmentation in diverse weather scenarios

Semantic Segmentation in Multiple Adverse Weather Conditions with Domain Knowledge Retention

Domain Adaptation based Object Detection for Autonomous Driving in Foggy and Rainy Weather

A Clearer Image: Improving Object Detection in Real Rainy Conditions with Two-Stage Processing

Threshold-adaptive Unsupervised Focal Loss for Domain Adaptation of Semantic Segmentation

Both Style and Fog Matter: Cumulative Domain Adaptation for Semantic Foggy Scene Understanding

Enhancing Autonomous Vehicle Perception in Adverse Weather through Image Augmentation during Semantic Segmentation Training

Exploiting Diverse Characteristics and Adversarial Ambivalence for Domain Adaptive Segmentation

Domain Adaptation for Semantic Segmentation of Road Scenes Via Two-Stage Alignment of Traffic Elements

Unsupervised Domain Adaptation for Remote Sensing Semantic Segmentation with Transformer

A Prior Guided Wavelet-Spatial Dual Attention Transformer Framework for Heavy Rain Image Restoration

Similarity-Based Multi-Target Domain Adaptation for Scene Text Spotting in Inclement Weather Conditions

Graph-based Multi-Source Domain Adaptation with Contrastive and Collaborative Learning for Image Deraining

Solution for CVPR 2024 UG2+ Challenge Track on All Weather Semantic Segmentation