Abstract:Given the impressive achievement of convolutional neural networks (CNNs) in grasping image priors from extensive datasets, they have been widely utilized for tasks related to image restoration. Recently, there is been significant progress in another category of neural architectures—Transformers. These models have demonstrated remarkable performance in natural language tasks and higher‐level vision applications. Despite their ability to address some of CNNs limitations, such as restricted receptive fields and adaptability issues, Transformer models often face difficulties when processing images with a high level of detail. This is because the complexity of the computations required increases significantly with the image's spatial resolution. As a result, their application to most high‐resolution image restoration tasks becomes impractical. In our research, we introduce a novel Transformer model, named DehFormer, by implementing specific design modifications in its fundamental components, for example, the multi‐head attention and feed‐forward network. Specifically, the proposed architecture consists of the three modules, that is, (a) multi‐scale feature aggregation network (MSFAN), (b) the gated‐Dconv feed‐forward network (GFFN), (c) and the multi‐Dconv head transposed attention (MDHTA). For the MDHTA module, our objective is to scrutinize the mechanics of scaled dot‐product attention through the utilization of per‐element product operations, thereby bypassing the need for matrix multiplications and operating directly in the frequency domain for enhanced efficiency. For the GFFN module, which enables only the relevant and valuable information to advance through the network hierarchy, thereby enhancing the efficiency of information flow within the model. Extensive experiments are conducted on the SateHazelk, RS‐Haze, and RSID datasets, resulting in performance that significantly exceeds that of existing methods.

DF3Net: Dual Frequency Feature Fusion Network with Hierarchical Transformer for Image Inpainting

Dual-Focal Camera Hdr Imaging Based On Convolutional Neural Network

A Double Feature Fusion Network with Progressive Learning for Sharper Inpainting

An Efficient Dehazing Algorithm Based on the Fusion of Transformer and Convolutional Neural Network.

Parallel Multi-Resolution Fusion Network for Image Inpainting.

CTFCD: Channel Transformer Based on Full Convolutional Decoder for Single Image Deraining

Multi-Modal Image Fusion Via Deep Laplacian Pyramid Hybrid Network

HDCTfusion: Hybrid Dual-Branch Network Based on CNN and Transformer for Infrared and Visible Image Fusion

An efficient multi‐scale transformer for satellite image dehazing

HINT: High-quality INPainting Transformer with Mask-Aware Encoding and Enhanced Attention

THFuse: An Infrared and Visible Image Fusion Network using Transformer and Hybrid Feature Extractor

A transformer–CNN for deep image inpainting forensics

An efficient parallel fusion structure of distilled and transformer-enhanced modules for lightweight image super-resolution

Frequency domain-enhanced transformer for single image deraining

DMTNet: Dynamic Multi-scale Network for Dual-pixel Images Defocus Deblurring with Transformer

Dual-Path Coupled Image Deraining Network via Spatial-Frequency Interaction

MAT: Mask-Aware Transformer for Large Hole Image Inpainting

Bridging partial-gated convolution with transformer for smooth-variation image inpainting

SyFormer: Structure-Guided Synergism Transformer for Large-Portion Image Inpainting

Hierarchical Feature Fusion Transformer for No-Reference Image Quality Assessment