Abstract:This paper reports on WaterGAN, a generative adversarial network (GAN) for generating realistic underwater images from in-air image and depth pairings in an unsupervised pipeline used for color correction of monocular underwater images. Cameras onboard autonomous and remotely operated vehicles can capture high resolution images to map the seafloor, however, underwater image formation is subject to the complex process of light propagation through the water column. The raw images retrieved are characteristically different than images taken in air due to effects such as absorption and scattering, which cause attenuation of light at different rates for different wavelengths. While this physical process is well described theoretically, the model depends on many parameters intrinsic to the water column as well as the objects in the scene. These factors make recovery of these parameters difficult without simplifying assumptions or field calibration, hence, restoration of underwater images is a non-trivial problem. Deep learning has demonstrated great success in modeling complex nonlinear systems but requires a large amount of training data, which is difficult to compile in deep sea environments. Using WaterGAN, we generate a large training dataset of paired imagery, both raw underwater and true color in-air, as well as depth data. This data serves as input to a novel end-to-end network for color correction of monocular underwater images. Due to the depth-dependent water column effects inherent to underwater environments, we show that our end-to-end network implicitly learns a coarse depth estimate of the underwater scene from monocular underwater images. Our proposed pipeline is validated with testing on real data collected from both a pure water tank and from underwater surveys in field testing. Source code is made publicly available with sample datasets and pretrained models.

DGD-cGAN: A dual generator for image dewatering and restoration

Depth-Conditioned GAN for Underwater Image Enhancement

Underwater Image Enhancement Using a Multiscale Dense Generative Adversarial Network

Dilated Generative Adversarial Networks for Underwater Image Restoration

Underwater image enhancement based on conditional generative adversarial network

Underwater single-image restoration based on modified generative adversarial net

Enhanced visual perception for underwater images based on multistage generative adversarial network

WaterGAN: Unsupervised Generative Network to Enable Real-time Color Correction of Monocular Underwater Images

A learnable full-frequency transformer dual generative adversarial network for underwater image enhancement

UW-CycleGAN: Model-Driven CycleGAN for Underwater Image Restoration

UP‐GAN: Channel‐spatial attention‐based progressive generative adversarial network for underwater image enhancement

ULD-CycleGAN: An Underwater Light Field and Depth Map-Optimized CycleGAN for Underwater Image Enhancement

Two-Stage Underwater Image Restoration Algorithm Based on Physical Model and Causal Intervention

Hierarchical attention aggregation with multi-resolution feature learning for GAN-based underwater image enhancement

New Approach to Underwater Image Enhancement Using Modified Residual Blocks in Generator Architecture for Improved Cycle Generative Adversarial Networks

An Underwater Image Enhancement Method for a Preprocessing Framework Based on Generative Adversarial Network

Generative adversarial networks with multi-scale and attention mechanisms for underwater image enhancement

A ConvNeXt-backbone cGAN for Underwater Power Engineering Image Enhancement

Towards Real-Time Advancement of Underwater Visual Quality With GAN

DifSG2-CCL: Image Reconstruction Based on Special Optical Properties of Water Body

DAE-GAN: Underwater Image Super-Resolution Based on Symmetric Degradation Attention Enhanced Generative Adversarial Network