Abstract:Since Transformers show a strong capability of building long-range dependencies, the relevant methods are extensively employed for image deraining tasks. However, the intrinsic limitations of Transformers, including costly computational complexity and insufficient ability to capture high-frequency components of the image, hinder the the utilization of Transformers in high-resolution images and lead to the unsatisfactory recovery of local edges and textures. To overcome these limitations, we propose an simple but effective Frequency Domain Enhanced Transformer (FDEFormer) for the image deraining. Firstly, drawing inspiration from the convolution theorem, we devise an efficient approach called frequency domain enhanced multi-head self-attention. The proposed approach replaces traditional matrix multiplication with element-wise product operations in the frequency domain, leading to a substantial reduction in computational complexity. Secondly, the existing spatial domain Transformers-based methods only focus on low-frequency features but pay less attention to high-frequency components, which can adversely affect the quality of the reconstructed images. Therefore, to integrate the content of different frequency levels, we propose a dual domain-complemented feed-forward network. Besides, we further present an attention feature fusion module to facilitate a more effective fusion of features across different layers. Extensive experiments on several datasets demonstrate that our FDEFormer performs favorably against state-of-the-art methods while taking acceptable computational costs. The source code and pre-trained models are available at https://github.com/bobozy1999/FDEFormer.

EWT: Efficient Wavelet-Transformer for Single Image Denoising

EWT: Efficient Wavelet-Transformer for single image denoising

Vision Transformers for Single Image Dehazing

Efficient Lightweight Image Denoising with Triple Attention Transformer

Single image denoising with a feature-enhanced network

DDT: Dual-branch Deformable Transformer for Image Denoising

A Dynamic Network with Transformer for Image Denoising

CTFCD: Channel Transformer Based on Full Convolutional Decoder for Single Image Deraining

Heterogeneous window transformer for image denoising

Enhanced Frequency Fusion Network with Dynamic Hash Attention for image denoising

Multi-stage image denoising with the wavelet transform

Exploration of Lightweight Single Image Denoising with Transformers and Truly Fair Training

A cross Transformer for image denoising

An Effective Masked Transformer Network for Image Denoising

Monte Carlo Denoising Via Multi-scale Auxiliary Feature Fusion Guided Transformer.

Hybrid Transformer-CNN for Real Image Denoising

DnSwin: Toward Real-World Denoising via Continuous Wavelet Sliding-Transformer

A Decoder-free Transformer-like Architecture for High-efficiency Single Image Deraining.

DnSwin: Toward real-world denoising via a continuous Wavelet Sliding Transformer

QFormer: an Efficient Quaternion Transformer for Image Denoising

Frequency domain-enhanced transformer for single image deraining