Infrared and visible image fusion based on infrared background suppression

Yang Yang,Zhennan Ren,Beichen Li,Yue Lang,Xiaoru Pan,Ruihai Li,Ming Ge

DOI: https://doi.org/10.1016/j.optlaseng.2023.107528

IF: 5.666

2023-05-01

Optics and Lasers in Engineering

Abstract:Because infrared images emphasize thermal targets while visible images provide a wealth of textural information, fusing the two modal images improves the human perception of the scene. When it comes to image fusion, it is essential to investigate the informative regions of both modal images and to leverage this prior knowledge during the fusion phase, in case of image degradation due to intermodal image interference. To this purpose, we present a fusion model in which the fusion process is guided by a thermal target mask, therefore alleviating cross-modal interference. This mask is created by suppressing the background of the infrared image, allowing thermal objects to be highlighted significantly, enabling for exploration of the associated regions. In addition, a two-channel multi-scale feature extraction network is designed to retain the semantic information from the two source images. We verify the presented model’s effectiveness using the public datasets, and the fused image of our method completely maintain the infrared image’s thermal targets and the visible image’s background texture information. Extensive experiments on publicly available datasets demonstrate that our model outperforms other state-of-the-art models in terms of both visual assessment and objective assessment.

optics