Abstract:Given the impressive achievement of convolutional neural networks (CNNs) in grasping image priors from extensive datasets, they have been widely utilized for tasks related to image restoration. Recently, there is been significant progress in another category of neural architectures—Transformers. These models have demonstrated remarkable performance in natural language tasks and higher‐level vision applications. Despite their ability to address some of CNNs limitations, such as restricted receptive fields and adaptability issues, Transformer models often face difficulties when processing images with a high level of detail. This is because the complexity of the computations required increases significantly with the image's spatial resolution. As a result, their application to most high‐resolution image restoration tasks becomes impractical. In our research, we introduce a novel Transformer model, named DehFormer, by implementing specific design modifications in its fundamental components, for example, the multi‐head attention and feed‐forward network. Specifically, the proposed architecture consists of the three modules, that is, (a) multi‐scale feature aggregation network (MSFAN), (b) the gated‐Dconv feed‐forward network (GFFN), (c) and the multi‐Dconv head transposed attention (MDHTA). For the MDHTA module, our objective is to scrutinize the mechanics of scaled dot‐product attention through the utilization of per‐element product operations, thereby bypassing the need for matrix multiplications and operating directly in the frequency domain for enhanced efficiency. For the GFFN module, which enables only the relevant and valuable information to advance through the network hierarchy, thereby enhancing the efficiency of information flow within the model. Extensive experiments are conducted on the SateHazelk, RS‐Haze, and RSID datasets, resulting in performance that significantly exceeds that of existing methods.

CPLFormer: Cross-scale Prototype Learning Transformer for Image Snow Removal

SnowFormer: Context Interaction Transformer with Scale-awareness for Single Image Desnowing

MSP-Former: Multi-Scale Projection Transformer for Single Image Desnowing

Towards an Effective and Efficient Transformer for Rain-by-snow Weather Removal

SGNet: Efficient Snow Removal Deep Network with a Global Windowing Transformer

Context-aware Coarse-to-fine Network for Single Image Desnowing

SCSNet: an Efficient Paradigm for Learning Simultaneously Image Colorization and Super-resolution

DesnowNet: Context-Aware Deep Network for Snow Removal

An Efficient Dehazing Algorithm Based on the Fusion of Transformer and Convolutional Neural Network.

GridFormer: Residual Dense Transformer with Grid Structure for Image Restoration in Adverse Weather Conditions

An efficient multi‐scale transformer for satellite image dehazing

Towards Real-time High-Definition Image Snow Removal: Efficient Pyramid Network with Asymmetrical Encoder-decoder Architecture

Deep Dense Multi-scale Network for Snow Removal Using Semantic and Geometric Priors

Dual-Path Multi-Scale Transformer for High-Quality Image Deraining

Star-Net: Improving Single Image Desnowing Model With More Efficient Connection and Diverse Feature Interaction

LMQFormer: A Laplace-Prior-Guided Mask Query Transformer for Lightweight Snow Removal

Learning A Sparse Transformer Network for Effective Image Deraining

CSPFormer: A cross-spatial pyramid transformer for visual place recognition

Contrastive Multiscale Transformer for Image Dehazing

Global–local transformer for single-image rain removal

SyFormer: Structure-Guided Synergism Transformer for Large-Portion Image Inpainting