A Deep Thermal-Guided Approach for Effective Low-Light Visible Image Enhancement.

Yanpeng Cao,Xi Tong,Fan Wang,Jiangxin Yang,Yanlong Cao,Sabin Tiberius Strat,Christel-Loic Tisse
DOI: https://doi.org/10.1016/j.neucom.2022.12.007
IF: 6
2023-01-01
Neurocomputing
Abstract:Low-light visible image enhancement is important for various visual computing applications under con-ditions of poor lighting or hazardous weather. However, existing low-light image enhancement methods are mostly based on a single visible channel and cannot achieve satisfactory performance when process-ing real-captured nighttime images. In this paper, we attempt to utilize the complementary edge/texture features presented in thermal images to provide a stable guidance map to facilitate the enhancement of features extracted on low-light visible images. For this purpose, we propose a novel Central Difference Convolution-based Multi-Receptive-Field (CDC-MRF) module to effectively extract multi-scale edge/tex-ture features on thermal images. Then, we design a thermal-guided convolutional block (TGCB) to enhance the low-light visible features under the guidance of thermal features. To our best knowledge, the proposed thermal-guided low-light image enhancement network (TGLLE-Net) represents the first attempt to perform low-light visible image enhancement by incorporating complementary information presented in both visible and thermal channels. The advantages of the proposed TGLLE-Net are twofold. Firstly, it is capable of suppressing severe noise disturbance presented in low-light visible images under the guidance of low-frequency components in thermal images. Moreover, TGLLE-Net can promote detail/ appearance restoration of objects with distinctive thermal features (e.g., pedestrians, vehicles, and build-ings). Both objective and subjective evaluation results demonstrate that our proposed TGLLE-Net outper-forms state-of-the-art methods in terms of restoration accuracy, visual perception, and computational efficiency.(c) 2022 Elsevier B.V. All rights reserved.
What problem does this paper attempt to address?