Abstract:The proliferation of ultra-high-definition (UHD) imaging device is increasingly being used for underwater image acquisition. However, due to light scattering and underwater impurities, UHD underwater images often suffer from color deviations and edge blurriness. Many studies have attempted to enhance underwater images by integrating frequency domain and spatial domain information. Nonetheless, these approaches often interactively fuse dual-domain features only in the final fusion module, neglecting the complementary and guiding roles of frequency domain and spatial domain features. Additionally, the extraction of dual-domain features is independent of each other, which leads to the sharp advantages and disadvantages of the dual-domain features extracted by these methods. Consequently, these methods impose high demands on the feature fusion capabilities of the fusion module. But in order to handle UHD underwater images, the fusion modules in these methods often stack only a limited number of convolution and activation function operations. This limitation results in insufficient fusion capability, leading to defects in the restoration of edges and colors in the images. To address these issues, we develop a dual-domain interaction network for enhancing UHD underwater images. The network takes into account both frequency domain and spatial domain features to complement and guide each other’s feature extraction patterns, and fully integrates the dual-domain features in the model to better recover image details and colors. Specifically, the network consists of a U-shaped structure, where each layer is composed of dual-domain interaction transformer blocks containing interactive multi-head attention and interactive simple gate feed-forward networks. The interactive multi-head attention captures local interaction features of frequency domain and spatial domain information using convolution operation, followed by multi-head attention operation to extract global information of the mixed features. The interactive simple gate feed-forward network further enhances the model’s dual-domain interaction capability and cross-dimensional feature extraction ability, resulting in clearer edges and more realistic colors in the images. Experimental results demonstrate that the performance of our proposal in enhancing underwater images is significantly better than existing methods.

MobileVitV2-Based Fusion of Vision Transformers and Convolutional Neural Networks for Underwater Image Enhancement

An effective transformer based on dual attention fusion for underwater image enhancement

Enhancement of Underwater Images through Parallel Fusion of Transformer and CNN

Global feature fusion generative adversarial network for underwater image enhancement

Underwater Image Enhancement Based on Color Feature Fusion

Underwater optical image enhancement based on super-resolution convolutional neural network and perceptual fusion

UWFormer: Underwater Image Enhancement via a Semi-Supervised Multi-Scale Transformer

Semi-DinatNet: Two-Stage Underwater Image Enhancement With Semi-Supervised Learning

WaterFormer: A Global–Local Transformer for Underwater Image Enhancement With Environment Adaptor

Underwater Image Enhancement via Dehazing and Color Restoration

Ultra-high-definition Underwater Image Enhancement Via Dual-Domain Interactive Transformer Network

A fusion framework with multi-scale convolution and triple-branch cascaded transformer for underwater image enhancement

A novel multi-stream fusion network for underwater image enhancement

A real-world underwater image enhancement method based on multi-color space and two-stage adaptive fusion

Underwater image enhancement using lightweight vision transformer

DDformer: Dimension decomposition transformer with semi-supervised learning for underwater image enhancement

A Multi-scale Feature Modulation Network for Efficient Underwater Image Enhancement

Hybrid CNN-Transformer Network for Two-Stage Underwater Image Enhancement with Contrastive Learning

MDNet: A Fusion Generative Adversarial Network for Underwater Image Enhancement

Multi-scale Enhancement Fusion for Underwater Sea Cucumber Images Based on Human Visual System Modelling

Swin Transformer and Fusion for Underwater Image Enhancement