Abstract:Vision-guided Autonomous Underwater Vehicles (AUVs) have gradually become significant tools for human exploration of the ocean. However, distorted images severely limit the visual ability, making it difficult to meet the needs of complex underwater environment perception. Fortunately, recent advancements in deep learning have led to rapid developments in underwater image enhancement. The emergence of the Transformer architecture has further enhanced the capabilities of deep learning. However, the direct application of Transformer to underwater image enhancement presents challenges in computing pixel-level global information and extracting local features. In this paper, we present a novel approach that merges dimension decomposition Transformer with semi-supervised learning for underwater image enhancement. To begin, dimension decomposition attention is proposed, which enables Transformer to compute global dependencies directly at the original scale and correct color distortions effectively. Concurrently, we employ convolutional neural networks to compensate for Transformer's limitations in extracting local features, thereby enriching details and textures. Subsequently, a multi-stage Transformer strategy is introduced to divide the network into high- and low-resolution stages for multi-scale global information extraction. It helps correct color distortions while enhancing the network's focus on regions with severe degradation. Moreover, we design a semi-supervised learning framework to reduce the reliance on paired datasets and construct a corresponding multi-scale fusion discriminator to enhance the sensitivity to input data. Experimental results demonstrate that our method outperforms state-of-the-art approaches, showcasing excellent learning and generalization capabilities on subjective perception and overall evaluation metrics. Furthermore, outstanding results highlight the significant improvements it brings to downstream visual engineering applications. The code of the proposed DDformer is available at https://github.com/ZhiGao-hfuu/DDformer .

Decomposer: Semi-supervised Learning of Image Restoration and Image Decomposition

Decompose Image into Meaningful Regions Based on Contour Detector and Watershed Algorithm

Decomposition Ascribed Synergistic Learning for Unified Image Restoration

Compositional Image Decomposition with Diffusion Models

Decomformer: Decompose Self-Attention of Transformer for Efficient Image Restoration

DIAR: Deep Image Alignment and Reconstruction using Swin Transformers

Multi-modal Degradation Feature Learning for Unified Image Restoration Based on Contrastive Learning

DDformer: Dimension decomposition transformer with semi-supervised learning for underwater image enhancement

Fusion from Decomposition: A Self-Supervised Decomposition Approach for Image Fusion

Total-Decom: Decomposed 3D Scene Reconstruction with Minimal Interaction

OneRestore: A Universal Restoration Framework for Composite Degradation

A Transformer-Based Decoder for Semantic Segmentation with Multi-level Context Mining

A new Image Decomposition Approach using Pixel-wise Analysis Sparsity Model

Disassembling object representations without labels

Revisiting Deep Image Smoothing and Intrinsic Image Decomposition.

Mixed Degradation Image Restoration via Local Dynamic Optimization and Conditional Embedding

Generative Adversarial Unsupervised Image Restoration in Hybrid Degradation Scenes

Shadow Removal via Shadow Image Decomposition

Image Reconstruction using Enhanced Vision Transformer

Intrinsic Image Decomposition by Pursuing Reflectance Image.

Learning to Restore Multiple Image Degradations Simultaneously