LatLRR-CNN: an Infrared and Visible Image Fusion Method Combining Latent Low-Rank Representation and CNN.
Yong Yang,Chengrui Gao,Zhangqiang Ming,Jixiang Guo,Edou Leopold,Junlong Cheng,Jie Zuo,Min Zhu
DOI: https://doi.org/10.1007/s11042-023-14967-0
IF: 2.577
2023-01-01
Multimedia Tools and Applications
Abstract:While infrared images have prominent targets and stable imaging, it can hardly maintain such detailed information or quality as texture or resolution. In contrast, although visible images have rich texture information and high resolution, the imaging is easily disturbed by the circumstance. Therefore, it is desirable to make up for shortcomings and integrate the advantages of the two images into one. In this paper, we propose an infrared and visible image fusion method that combines latent low-rank representation(LatLRR) and convolutional neural network(CNN), termed as LatLRR-CNN. This method can prevent loss of information, lack of imaging quality, and designing complex fusion rules or networks. Firstly, LatLRR is used to decompose infrared or visible images into low-rank parts and salient parts. Secondly, these two parts are fused separately using CNN. Finally, the fused low-rank part and the fused salient part are merged to obtain the fused image. Experiments on publicly accessible datasets reveal that our method outperforms state-of-the-art methods in terms of objective metrics and visual effects. Specifically, the average of our method on the Nato sequence, EN reaches 7.59, MI reaches 2.89, SD reaches 57.77, and VIf reaches 0.51.