Unsupervised haze removal from underwater images

Praveen Kandula,A. N. Rajagopalan
2023-06-05
Abstract:Several supervised networks exist that remove haze information from underwater images using paired datasets and pixel-wise loss functions. However, training these networks requires large amounts of paired data which is cumbersome, complex and time-consuming. Also, directly using adversarial and cycle consistency loss functions for unsupervised learning is inaccurate as the underlying mapping from clean to underwater images is one-to-many, resulting in an inaccurate constraint on the cycle consistency loss. To address these issues, we propose a new method to remove haze from underwater images using unpaired data. Our model disentangles haze and content information from underwater images using a Haze Disentanglement Network (HDN). The disentangled content is used by a restoration network to generate a clean image using adversarial losses. The disentangled haze is then used as a guide for underwater image regeneration resulting in a strong constraint on cycle consistency loss and improved performance gains. Different ablation studies show that the haze and content from underwater images are effectively separated. Exhaustive experiments reveal that accurate cycle consistency constraint and the proposed network architecture play an important role in yielding enhanced results. Experiments on UFO-120, UWNet, UWScenes, and UIEB underwater datasets indicate that the results of our method outperform prior art both visually and quantitatively.
Computer Vision and Pattern Recognition,Artificial Intelligence
What problem does this paper attempt to address?
The problem this paper attempts to address is the removal of haze information from underwater images, particularly achieving this goal without supervised paired data. Many existing networks remove haze information from underwater images through paired datasets and pixel-level loss functions, but this approach requires a large amount of paired data, which is cumbersome and time-consuming in practical operations. Moreover, directly using adversarial and cycle consistency loss functions for unsupervised learning is inaccurate because the mapping from clear images to underwater images is a one-to-many relationship, leading to inaccurate cycle consistency loss constraints. To solve these issues, the paper proposes a new method that removes haze from underwater images using unpaired data. This method employs a Haze Decoupling Network (HDN) to separate haze and content information from underwater images. The decoupled content information is used by the restoration network to generate clear images, while the decoupled haze information guides the regeneration of underwater images, thereby achieving strong constraints on cycle consistency loss and improving performance. Experimental results show that this method outperforms previous methods on multiple underwater datasets (such as UFO-120, UWNet, UWScenes, and UIEB) in terms of both visual effects and quantitative metrics.