A two-stage and two-branch generative adversarial network-based underwater image enhancement

Yong Lai,Haiyong Xu,Chi Lin,Ting Luo,Lihong Wang
DOI: https://doi.org/10.1007/s00371-022-02580-5
2022-07-14
Abstract:Due to the absorption and scattering of light under the water, various distortions are formed in the underwater images, which seriously limit the underwater visual task. To address this problem, a two-stage and two-branch underwater image enhancement generative adversarial network (TTE-GAN) is proposed. Specifically, considering the characteristics of the underwater images in different frequency domains in the first stage of the generator, guided filtering is used to decompose the raw underwater images, and two branches of low-frequency and high-frequency images are obtained. Since the low-frequency information represents the comprehensive measurement of the intensity of the image, the multi-scale module is used to enhance the comprehensive measurement of the image intensity. Considering that high frequency is a measure of the edge information of an image, a convolutional neural network is constructed for high-frequency information. Furthermore, due to the complexity of the underwater images, a single-step network is challenging to achieve good results. A refinement network is designed to improve the quality of the underwater image, thereby obtaining high-quality underwater images in the second stage of the generator. Finally, comprehensive experiments on three benchmarks demonstrate the validity of the proposed TTE-GAN method both subjectively and objectively.
computer science, software engineering
What problem does this paper attempt to address?