UIE-FSMC: Underwater Image Enhancement Based on Few-Shot Learning and Multi-Color Space
Nianzu Qiao,Jia Sun,Quanbo Ge,Changyin Sun
DOI: https://doi.org/10.1109/tcsvt.2023.3253898
IF: 5.859
2023-01-01
IEEE Transactions on Circuits and Systems for Video Technology
Abstract:Light propagates in water with certain attenuation, which causes quality problems, such as color cast, low contrast, and low illumination, in underwater images. Moreover, it is generally difficult to obtain a large number of real-world underwater images and the corresponding ground truth in convoluted underwater environments. To address these two problems, this article recommends an underwater image enhancement scheme based on few-shot learning and multi-color space, called UIE-FSMC. Specifically, for the first time, we propose a lightweight underwater image enhancement network based on few-shot learning. We design a new strategy to train the network. Specific training steps include the following: First, synthetic underwater images are used for large-scale pre-training, which can obtain the initial weight of the network. Then, according to the characteristics of the data, meta-learning based on supervised and unsupervised loss is suggested. It further enhances the feature expression aptitude of the network by learning the external and internal characteristics of the data. Finally, fine-tuning based on supervised and unsupervised loss is designed. It further improves the accuracy, robustness, and generalization of the network through an average strategy. In addition, we design a post-processing method founded on the RGB and LAB color spaces. In the RGB color space, we suggest a local region-based adaptive color correction method for underwater images. In the LAB color space, we design a multi-scale local adaptive contrast enhancement method for the L channel and a local region-based color balance strategy for the AB channels. Quantitative and qualitative experiments on five different underwater image datasets show that the outcomes of UIE-FSMC are superior to those of other techniques. Furthermore, application research further validates the excellent performance of UIE-FSMC.
engineering, electrical & electronic