Abstract:Underwater image datasets are crucial in underwater vision research. Because of the strong absorption and scattering effects that occur underwater, some ground truth such as the depth map, which can be easily collected in-air, becomes a great challenge in underwater environments. To solve the issues associated with the lack of underwater ground truth, we propose a trainable end-to-end system of an underwater multistyle generative adversarial network (UMGAN) that takes advantage of a cycle-consistent adversarial network (CycleGAN) and conditional generative adversarial networks. This system can generate multiple realistic underwater images from in-air images using a hybrid adversarial system and an unpaired method. Moreover, our model can translate in-air images to underwater images that retain the main content and structural information of the in-air images under specified turbidities or water styles through a style classifier and a conditional vector. Furthermore, we define the color loss and include the structural similarity index measure loss for the system to preserve the content and structure of original in-air images while transferring the backgrounds of the images from air to water. Using UMGAN, we can take advantage of the in-air ground truth and convert the corresponding in-air images into an underwater dataset with multiple water color styles. Our experiments demonstrate that our synthesized underwater images have a high score on image assessment against CycleGAN, WaterGAN, StarGAN, AdaIN, and other state-of-the-art methods. We also show that our synthesized underwater images with in-air depths can be applied to real underwater image depth map estimation.

Multi-scale Adversarial Network for Underwater Image Restoration

Depth-Conditioned GAN for Underwater Image Enhancement

UW-CycleGAN: Model-Driven CycleGAN for Underwater Image Restoration

Underwater Image Enhancement Using a Multiscale Dense Generative Adversarial Network

Research on Underwater Image Restoration Algorithm Based on Generative Adversarial Network

Multi-scale Iterative Network for Underwater Image Restoration

Multi-scale convolution underwater image restoration network

Underwater single-image restoration based on modified generative adversarial net

Dilated Generative Adversarial Networks for Underwater Image Restoration

Two-Stage Underwater Image Restoration Algorithm Based on Physical Model and Causal Intervention

Generative adversarial networks with multi-scale and attention mechanisms for underwater image enhancement

Towards Quality Advancement of Underwater Machine Vision with Generative Adversarial Networks

Underwater-GAN: Underwater Image Restoration Via Conditional Generative Adversarial Network

MDSCN: multiscale depthwise separable convolutional network for underwater graphics restoration

Two-stage underwater image restoration based on gan and optical model

Underwater Image Restoration with Light-Aware Progressive Network

The Synthesis of Unpaired Underwater Images Using a Multistyle Generative Adversarial Network

Underwater image restoration with multi-scale shallow feature extraction and detail enhancement network

Underwater Image Enhancement Method Based on the Generative Adversarial Network.

Underwater image enhancement based on conditional generative adversarial network

A Novel Generative Adversarial Network for Underwater Image Enhancement