Abstract:Monocular depth estimation has experienced significant progress on terrestrial images in recent years, largely due to deep learning advancements. However, it remains inadequate for underwater scenes, primarily because of data scarcity. Given the inherent challenges of light attenuation and backscattering in water, acquiring clear underwater images or precise depth information is notably difficult and costly. Consequently, learning-based approaches often rely on synthetic data or turn to unsupervised or self-supervised methods to mitigate this lack of data. Nonetheless, the performance of these methods is often constrained by the domain gap and looser constraints. In this paper, we propose a novel pipeline for generating photorealistic underwater images using accurate terrestrial depth data. This approach facilitates the training of supervised models for underwater depth estimation, effectively reducing the performance disparity between terrestrial and underwater environments. Contrary to prior synthetic datasets that merely apply style transfer to terrestrial images without altering the scene content, our approach uniquely creates vibrant, non-existent underwater scenes by leveraging terrestrial depth data through the innovative Stable Diffusion model. Specifically, we introduce a unique Depth2Underwater ControlNet, trained on specially prepared \{Underwater, Depth, Text\} data triplets, for this generation task. Our newly developed dataset enables terrestrial depth estimation models to achieve considerable improvements, both quantitatively and qualitatively, on unseen underwater images, surpassing their terrestrial pre-trained counterparts. Moreover, the enhanced depth accuracy for underwater scenes also aids underwater image restoration techniques that rely on depth maps, further demonstrating our dataset's utility. The dataset will be available at <a class="link-external link-https" href="https://github.com/zkawfanx/Atlantis" rel="external noopener nofollow">this https URL</a>.

Unpaired Underwater Image Synthesis with a Disentangled Representation for Underwater Depth Map Prediction

The Synthesis of Unpaired Underwater Images for Monocular Underwater Depth Prediction

A Depth Estimation Framework Based on Unsupervised Learning and Cross-Modal Translation

Depth-Conditioned GAN for Underwater Image Enhancement

An Underwater Image Enhancement Model for Domain Adaptation

Single Underwater Image Enhancement Using an Analysis-Synthesis Network

Real-time Underwater 3D Reconstruction Based on Monocular Image

Atlantis: Enabling Underwater Depth Estimation with Stable Diffusion

Unformer: A Transformer-Based Approach for Adaptive Multi-Scale Feature Aggregation in Underwater Image Enhancement

Unsupervised Single Image Underwater Depth Estimation

WaterMono: Teacher-Guided Anomaly Masking and Enhancement Boosting for Robust Underwater Self-Supervised Monocular Depth Estimation

UWStereo: A Large Synthetic Dataset for Underwater Stereo Matching

Redefining Accuracy: Underwater Depth Estimation for Irregular Illumination Scenes

Learning Scribbles for Dense Depth: Weakly Supervised Single Underwater Image Depth Estimation Boosted by Multitask Learning

Unsupervised Multiple Representation Disentanglement Framework for Improved Underwater Visual Perception

Unsupervised underwater image enhancement via content-style representation disentanglement

Underwater Image Enhancement based on Deep Learning and Image Formation Model

Underwater image enhancement utilizing adaptive color correction and model conversion for dehazing

UMono: Physical Model Informed Hybrid CNN-Transformer Framework for Underwater Monocular Depth Estimation

Depth Map Reconstruction for Underwater Kinect Camera Using Inpainting and Local Image Mode Filtering

An adaptive interpolation and 3D reconstruction algorithm for underwater images