Abstract:Given the impressive achievement of convolutional neural networks (CNNs) in grasping image priors from extensive datasets, they have been widely utilized for tasks related to image restoration. Recently, there is been significant progress in another category of neural architectures—Transformers. These models have demonstrated remarkable performance in natural language tasks and higher‐level vision applications. Despite their ability to address some of CNNs limitations, such as restricted receptive fields and adaptability issues, Transformer models often face difficulties when processing images with a high level of detail. This is because the complexity of the computations required increases significantly with the image's spatial resolution. As a result, their application to most high‐resolution image restoration tasks becomes impractical. In our research, we introduce a novel Transformer model, named DehFormer, by implementing specific design modifications in its fundamental components, for example, the multi‐head attention and feed‐forward network. Specifically, the proposed architecture consists of the three modules, that is, (a) multi‐scale feature aggregation network (MSFAN), (b) the gated‐Dconv feed‐forward network (GFFN), (c) and the multi‐Dconv head transposed attention (MDHTA). For the MDHTA module, our objective is to scrutinize the mechanics of scaled dot‐product attention through the utilization of per‐element product operations, thereby bypassing the need for matrix multiplications and operating directly in the frequency domain for enhanced efficiency. For the GFFN module, which enables only the relevant and valuable information to advance through the network hierarchy, thereby enhancing the efficiency of information flow within the model. Extensive experiments are conducted on the SateHazelk, RS‐Haze, and RSID datasets, resulting in performance that significantly exceeds that of existing methods.

DecomFormer: Decompose Self-Attention Via Fourier Transform for VHR Aerial Image Scene Classification

Contextual Learning in Fourier Complex Field for VHR Remote Sensing Images

Deep Feature Fusion for High-Resolution Aerial Scene Classification

Decomformer: Decompose Self-Attention of Transformer for Efficient Image Restoration

AerialFormer: Multi-resolution Transformer for Aerial Image Segmentation

Weighted residual self-attention graph-based transformer for spectral–spatial hyperspectral image classification

AAFormer: Attention-Attended Transformer for Semantic Segmentation of Remote Sensing Images

Remote Sensing Image Classification Based on Non-Linear Enhanced Attention Mechanism

Modify Self-Attention Via Skeleton Decomposition for Effective Point Cloud Transformer.

Deep Hierarchical Vision Transformer for Hyperspectral and LiDAR Data Classification

SVAFormer: Integrating Random and Hierarchical Spectral View Attention for Hyperspectral Image Classification

TripleFormer: improving transformer-based image classification method using multiple self-attention inputs

MHIAIFormer: Multi-Head Interacted and Adaptive Integrated Transformer with Spatial-Spectral Attention for Hyperspectral Image Classification

MHIAIFormer: Multihead Interacted and Adaptive Integrated Transformer With Spatial-Spectral Attention for Hyperspectral Image Classification

Fractional Fourier Image Transformer for Multimodal Remote Sensing Data Classification

SpectralFormer: Rethinking Hyperspectral Image Classification With Transformers

An efficient multi‐scale transformer for satellite image dehazing

From Plane to Hierarchy: Deformable Transformer for Remote Sensing Image Captioning

Hybrid Attention Fusion Embedded in Transformer for Remote Sensing Image Semantic Segmentation

Double Attention Transformer for Hyperspectral Image Classification