Abstract:Monocular depth estimation has experienced significant progress on terrestrial images in recent years, largely due to deep learning advancements. However, it remains inadequate for underwater scenes, primarily because of data scarcity. Given the inherent challenges of light attenuation and backscattering in water, acquiring clear underwater images or precise depth information is notably difficult and costly. Consequently, learning-based approaches often rely on synthetic data or turn to unsupervised or self-supervised methods to mitigate this lack of data. Nonetheless, the performance of these methods is often constrained by the domain gap and looser constraints. In this paper, we propose a novel pipeline for generating photorealistic underwater images using accurate terrestrial depth data. This approach facilitates the training of supervised models for underwater depth estimation, effectively reducing the performance disparity between terrestrial and underwater environments. Contrary to prior synthetic datasets that merely apply style transfer to terrestrial images without altering the scene content, our approach uniquely creates vibrant, non-existent underwater scenes by leveraging terrestrial depth data through the innovative Stable Diffusion model. Specifically, we introduce a unique Depth2Underwater ControlNet, trained on specially prepared \{Underwater, Depth, Text\} data triplets, for this generation task. Our newly developed dataset enables terrestrial depth estimation models to achieve considerable improvements, both quantitatively and qualitatively, on unseen underwater images, surpassing their terrestrial pre-trained counterparts. Moreover, the enhanced depth accuracy for underwater scenes also aids underwater image restoration techniques that rely on depth maps, further demonstrating our dataset's utility. The dataset will be available at <a class="link-external link-https" href="https://github.com/zkawfanx/Atlantis" rel="external noopener nofollow">this https URL</a>.

AG‐SDM: Aquascape generation based on stable diffusion model with low‐rank adaptation

Layout Optimization for Underwater Nozzle Array of Air-Lifted Artificial Upwelling System Based on Discrete Particle Swarm Algorithm

Aquatic-GS: A Hybrid 3D Representation for Underwater Scenes

Novel 3D-Aware Composition Images Synthesis for Object Display with Diffusion Model.

Anemone Image Generation Based on Diffusion-Stylegan2

DifSG2-CCL: Image Reconstruction Based on Special Optical Properties of Water Body

ART3D: 3D Gaussian Splatting for Text-Guided Artistic Scenes Generation

Layout2Rendering: AI-aided Greenspace design

StableDreamer: Taming Noisy Score Distillation Sampling for Text-to-3D

Artistic Intelligence: A Diffusion-Based Framework for High-Fidelity Landscape Painting Synthesis

Aquavision Alchemy Illuminating Underwater Imagery Through Medium Transmission

Atlantis: Enabling Underwater Depth Estimation with Stable Diffusion

UDR-GS: Enhancing Underwater Dynamic Scene Reconstruction with Depth Regularization

A New Chinese Landscape Paintings Generation Model based on Stable Diffusion using DreamBooth

APNet-YOLOv8s: A real-time automatic aquatic plants recognition algorithm for complex environments

Underwater litter monitoring using consumer-grade aerial-aquatic speedy scanner (AASS) and deep learning based super-resolution reconstruction and detection network

Lightweight Multi-Scales Feature Diffusion for Image Inpainting Towards Underwater Fish Monitoring

Toward Sufficient Spatial-Frequency Interaction for Gradient-aware Underwater Image Enhancement

Enhanced 3D Generation by 2D Editing

Riverbed litter monitoring using consumer-grade aerial-aquatic speedy scanner (AASS) and deep learning based super-resolution reconstruction and detection network

Semantic Score Distillation Sampling for Compositional Text-to-3D Generation