Metalantis: A Comprehensive Underwater Image Enhancement Framework

Hao Wang,Weibo Zhang,Lu Bai,Peng Ren

DOI: https://doi.org/10.1109/tgrs.2024.3387722

IF: 8.2

2024-04-24

IEEE Transactions on Geoscience and Remote Sensing

Abstract:Underwater images normally suffer from visual degradation issues such as color deviations, low contrasts, and blurred details. Recently, numerous underwater image enhancement algorithms have been proposed to address these issues. However, constrained by underwater conditions, acquiring nonunderwater images and depth maps for underwater images is often challenging. This limitation significantly hampers the performance of data-driven-based methods and physical model-based methods. In addition, existing physical model-based methods typically require manual parameter settings, which tend to be bruteforce and insufficient to effectively address the diverse underwater scenes. To overcome these limitations, this article presents a comprehensive underwater image enhancement framework comprising three phases: meta submergence (metamergence), meta relief (metalief), and meta ebb (metaebb). These phases are dedicated to virtual underwater image synthesis, underwater image depth map estimation, and the configuration of state-of-the-art physical models for underwater image enhancement by reinforcement learning, separately. While the three phases are trained separately, the former phase provides the necessary data for training the latter. We refer to the overall three phases as metalantis (i.e., meta Atlantis) because its training processes, involving variations from submergence via relief to ebb over indoor scenes, mimic the virtual variations of Atlantis. The metalantis framework empowers state-of-the-art physical models of underwater imaging through reinforcement learning with virtually generated data. The well-trained metalantis framework can take an underwater image as the sole input, process it into virtual representations, and finally enhance it. Comprehensive qualitative and quantitative empirical evaluations validate that our metalantis framework outperforms state-of-the-art underwater image enhancement methods. We release our code at https://gitee.com/wanghaoupc/Metalantis_UIE.

imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics