Abstract:Given the impressive achievement of convolutional neural networks (CNNs) in grasping image priors from extensive datasets, they have been widely utilized for tasks related to image restoration. Recently, there is been significant progress in another category of neural architectures—Transformers. These models have demonstrated remarkable performance in natural language tasks and higher‐level vision applications. Despite their ability to address some of CNNs limitations, such as restricted receptive fields and adaptability issues, Transformer models often face difficulties when processing images with a high level of detail. This is because the complexity of the computations required increases significantly with the image's spatial resolution. As a result, their application to most high‐resolution image restoration tasks becomes impractical. In our research, we introduce a novel Transformer model, named DehFormer, by implementing specific design modifications in its fundamental components, for example, the multi‐head attention and feed‐forward network. Specifically, the proposed architecture consists of the three modules, that is, (a) multi‐scale feature aggregation network (MSFAN), (b) the gated‐Dconv feed‐forward network (GFFN), (c) and the multi‐Dconv head transposed attention (MDHTA). For the MDHTA module, our objective is to scrutinize the mechanics of scaled dot‐product attention through the utilization of per‐element product operations, thereby bypassing the need for matrix multiplications and operating directly in the frequency domain for enhanced efficiency. For the GFFN module, which enables only the relevant and valuable information to advance through the network hierarchy, thereby enhancing the efficiency of information flow within the model. Extensive experiments are conducted on the SateHazelk, RS‐Haze, and RSID datasets, resulting in performance that significantly exceeds that of existing methods.

Deep Fuzzy Clustering Transformer: Learning the General Property of Corruptions for Degradation-Agnostic Multitask Image Restoration

Deep Fuzzy Clustering Transformer: Learning the General Property of Corruptions for Degradation-Agnostic Multi-Task Image Restoration

Modular Degradation Simulation and Restoration for Under-Display Camera

Multi-modal Degradation Feature Learning for Unified Image Restoration Based on Contrastive Learning

An Efficient Dehazing Algorithm Based on the Fusion of Transformer and Convolutional Neural Network.

Joint multi-dimensional dynamic attention and transformer for general image restoration

Multi-Weather Degradation-Aware Transformer for Image Restoration

Referring Flexible Image Restoration

All-in-one Multi-degradation Image Restoration Network via Hierarchical Degradation Representation

OneRestore: A Universal Restoration Framework for Composite Degradation

Restorer: Removing Multi-Degradation with All-Axis Attention and Prompt Guidance

An efficient multi‐scale transformer for satellite image dehazing

Contrastive Multiscale Transformer for Image Dehazing

Correlation Matching Transformation Transformers for UHD Image Restoration

UTDM: a universal transformer-based diffusion model for multi-weather-degraded images restoration

GRIDS: Grouped Multiple-Degradation Restoration with Image Degradation Similarity

Learning Frequency-Aware Dynamic Transformers for All-In-One Image Restoration

Learning A Coarse-to-Fine Diffusion Transformer for Image Restoration

Degradation Adaption Local-to-Global Transformer for Low-Dose CT Image Denoising

Decomposition Ascribed Synergistic Learning for Unified Image Restoration

Mixed Degradation Image Restoration via Local Dynamic Optimization and Conditional Embedding