Abstract:The proliferation of ultra-high-definition (UHD) imaging device is increasingly being used for underwater image acquisition. However, due to light scattering and underwater impurities, UHD underwater images often suffer from color deviations and edge blurriness. Many studies have attempted to enhance underwater images by integrating frequency domain and spatial domain information. Nonetheless, these approaches often interactively fuse dual-domain features only in the final fusion module, neglecting the complementary and guiding roles of frequency domain and spatial domain features. Additionally, the extraction of dual-domain features is independent of each other, which leads to the sharp advantages and disadvantages of the dual-domain features extracted by these methods. Consequently, these methods impose high demands on the feature fusion capabilities of the fusion module. But in order to handle UHD underwater images, the fusion modules in these methods often stack only a limited number of convolution and activation function operations. This limitation results in insufficient fusion capability, leading to defects in the restoration of edges and colors in the images. To address these issues, we develop a dual-domain interaction network for enhancing UHD underwater images. The network takes into account both frequency domain and spatial domain features to complement and guide each other’s feature extraction patterns, and fully integrates the dual-domain features in the model to better recover image details and colors. Specifically, the network consists of a U-shaped structure, where each layer is composed of dual-domain interaction transformer blocks containing interactive multi-head attention and interactive simple gate feed-forward networks. The interactive multi-head attention captures local interaction features of frequency domain and spatial domain information using convolution operation, followed by multi-head attention operation to extract global information of the mixed features. The interactive simple gate feed-forward network further enhances the model’s dual-domain interaction capability and cross-dimensional feature extraction ability, resulting in clearer edges and more realistic colors in the images. Experimental results demonstrate that the performance of our proposal in enhancing underwater images is significantly better than existing methods.

Multi-Scale and Multi-Path Networks for Simultaneous Enhancement and Super-Resolution of Underwater Images

Multi-Scale Cross-Attention Fusion Network Based on Image Super-Resolution

A Multi-Scale Feature Extraction Network for Marine Underwater Image Enhancement

Multi-scale dense spatially-adaptive residual distillation network for lightweight underwater image super-resolution

Underwater-image super-resolution via range-dependency learning of multiscale features

Multi-Domain Rapid Enhancement Networks for Underwater Images

Agent-Guided Non-Local Network for Underwater Image Enhancement and Super-Resolution Using Multi-Color Space

Underwater image restoration with multi-scale shallow feature extraction and detail enhancement network

Synergistic Multiscale Detail Refinement via Intrinsic Supervision for Underwater Image Enhancement

Multi-scale convolution underwater image restoration network

Multi-view underwater image enhancement method via embedded fusion mechanism

Underwater image enhancement using scale-patch synergy transformer

Robust underwater image enhancement with cascaded multi-level sub-networks and triple attention mechanism

Ultra-high-definition Underwater Image Enhancement Via Dual-Domain Interactive Transformer Network

Multiscale Underwater Image Enhancement in RGB and HSV Color Spaces

Autonomous Underwater Robot for Underwater Image Enhancement Via Multi-Scale Deformable Convolution Network with Attention Mechanism

Freud's brain: toward a unified neuropsychodynamic model of personality and psychotherapy.

A novel multi-stream fusion network for underwater image enhancement

Generative adversarial networks with multi-scale and attention mechanisms for underwater image enhancement

A Multi-Stage Progressive Network with Feature Transmission and Fusion for Marine Snow Removal

USNet: underwater image superpixel segmentation via multi-scale water-net