Abstract:Infrared images and visible images have different imaging principles and contain different information. The fusion of infrared and visible images can synthesize the information of both, and at the same time, the complete edge structure of infrared images can guarantee the acquisition of image information under harsh and complex environments. Therefore, this paper proposes an infrared and visible image fusion method based on deep learning. Visible and infrared image pairs are divided into high-frequency and low-frequency parts in this paper. The weighted average strategy is directly used to add the low-frequency parts of the fused image. This method Uses the ResNet network to visible and infrared images of the high frequency parts of image feature extraction. FISHER discriminant method was used to screen the extracted features, and ZCA whitening was performed on the selected features to further remove the redundant information in the features. The initial weight graph was obtained by L1 generalization of the whitening features, and the final weight graph was obtained by softmax method. The high-frequency parts of infrared image and visible light image were added according to the weights to get the fused image high-frequency part, and the high and low frequency parts of the fused image were added to get the final fused image. The experimental results were compared with other methods in terms of subjective feeling and objective indicators respectively. The experimental results showed that the proposed method was more natural in fusion effect and had advantages in objective indicators.

Fusion of Multi-Resolution Visible Image and Infrared Images Based on Guided Filter

Fusion Of Infrared And Visible Light Images Based On Nonsubsampled Shearlet Transform

Fusion of infrared and visual images through multiscale hybrid unidirectional total variation

Fusion of Visible and Infrared Images Using Saliency Analysis and Detail Preserving Based Image Decomposition

Infrared and visible image fusion method based on saliency detection and target-enhancement

Detail preserved fusion of visible and infrared images using regional saliency extraction and multi-scale image decomposition

Two-scale Image Fusion of Visible and Infrared Images Using Guided Filter

Night Vision Image Fusion Based on Phase Information Modulation and Image Enhancement Technique

Fusion of Low-Quality Visible and Infrared Images Based on Multi-Level Latent Low-Rank Representation Joint with Retinex Enhancement and Multi-Visual Weight Information

Infrared and Visible Image Fusion with Hybrid Image Filtering

Visible and Infrared Image Fusion Based on Attention and Multiscale Residuals

Adaptive low light visual enhancement and high-significant target detection for infrared and visible image fusion

Infrared and Visible Image Fusion Based on Filtering Enhancement

Fusion of Infrared and Visible Images Based on Three-Scale Decomposition and ResNet Feature Transfer

Beyond Night Visibility: Adaptive Multi-Scale Fusion of Infrared and Visible Images

An infrared and visible image fusion algorithm based on ResNet-152

Multi-Scale Fusion of Stretched Infrared and Visible Images

Multi-Sensor Fusion of Infrared and Visible Images Based on Modified Side Window Filter and Intensity Transformation

Infrared and Visible Image Fusion under Different Illumination Conditions Based on Illumination Effective Region Map.

Infrared and Visual Image Fusion Based on a Local-Extrema-Driven Image Filter

An infrared and visible image fusion method based on deep learning