Abstract:Owing to the light absorption and wavelength scattering in underwater environments, underwater images are severely degraded, which directly affects the depth estimation of underwater scenes. Accurate underwater depth estimation is essential for representing and understanding underwater scenes. However, the existing underwater depth estimation methods have not fully taken into account the distinctive physical properties of underwater environments, which has resulted in increased bias and feature distortion in the depth estimation results. In this article, an underwater monocular depth estimation method based on physical-guided Transformer (UPGformer) is proposed, considering the characteristics of underwater imaging, including shallow feature extraction, encoding, decoding, and regression stages. Specifically, in the shallow feature extraction stage, considering the color deviation of underwater images and extracting richer primary features, an enrichment and extraction depth Transformer (EEDT) module is proposed, by interacting physically inverted transmission maps of the underwater dark channel prior (UDCP) with physical color-compensated underwater images through self-attention. In the encoding stage, considering the nonuniform degradation of underwater images (nonuniform local distortion and inconsistent channel degradation), the underwater physical Transformer interaction encoder (UPTE) module, which fuses the Transformer and physically inverted transmission maps, is proposed. Furthermore, in the decoding stage, to better recover features and reduce information loss, the underwater physical embedded decoding (UPED) module is proposed, which embeds the physically inverted transmission maps with the upsampling process. Finally, the depth map is constructed during the regression stage. The experimental results demonstrate that the proposed UPGformer outperforms existing methods, both qualitatively and quantitatively.

UMono: Physical Model Informed Hybrid CNN-Transformer Framework for Underwater Monocular Depth Estimation

Monocular Depth Estimation Based on Unsupervised Learning

A Depth Estimation Framework Based on Unsupervised Learning and Cross-Modal Translation

MFF-Net: Towards Efficient Monocular Depth Completion With Multi-Modal Feature Fusion

WaterMono: Teacher-Guided Anomaly Masking and Enhancement Boosting for Robust Underwater Self-Supervised Monocular Depth Estimation

Underwater Monocular Depth Estimation Based on Physical-Guided Transformer

Unformer: A Transformer-Based Approach for Adaptive Multi-Scale Feature Aggregation in Underwater Image Enhancement

Monocular depth estimation with hierarchical fusion of dilated CNNs and soft-weighted-sum inference

Real-time Underwater 3D Reconstruction Based on Monocular Image

Lightweight Self-Supervised Monocular Depth Estimation Through CNN and Transformer Integration

UDepth: Fast Monocular Depth Estimation for Visually-guided Underwater Robots

Towards Comprehensive Monocular Depth Estimation: Multiple Heads are Better Than One

Metrically Scaled Monocular Depth Estimation through Sparse Priors for Underwater Robots

Monocular Depth Estimation Algorithm Integrating Parallel Transformer and Multi-Scale Features

Monocular Depth Estimation With Affinity, Vertical Pooling, And Label Enhancement

A Physical Model-Guided Framework for Underwater Image Enhancement and Depth Estimation

Lite-Mono: A Lightweight CNN and Transformer Architecture for Self-Supervised Monocular Depth Estimation

Deep Neighbor Layer Aggregation for Lightweight Self-Supervised Monocular Depth Estimation

PCTDepth: Exploiting Parallel CNNs and Transformer via Dual Attention for Monocular Depth Estimation

UWFormer: Underwater Image Enhancement via a Semi-Supervised Multi-Scale Transformer

Underwater scene prior inspired deep underwater image and video enhancement