Abstract:Infrared–visible image fusion is valuable across various applications due to the complementary information that it provides. However, the current fusion methods face challenges in achieving high-quality fused images. This paper identifies a limitation in the existing fusion framework that affects the fusion quality: modal differences between infrared and visible images are often overlooked, resulting in the poor fusion of the two modalities. This limitation implies that features from different sources may not be consistently fused, which can impact the quality of the fusion results. Therefore, we propose a framework that utilizes feature-based decomposition and domain normalization. This decomposition method separates infrared and visible images into common and unique regions. To reduce modal differences while retaining unique information from the source images, we apply domain normalization to the common regions within the unified feature space. This space can transform infrared features into a pseudo-visible domain, ensuring that all features are fused within the same domain and minimizing the impact of modal differences during the fusion process. Noise in the source images adversely affects the fused images, compromising the overall fusion performance. Thus, we propose the non-local Gaussian filter. This filter can learn the shape and parameters of its filtering kernel based on the image features, effectively removing noise while preserving details. Additionally, we propose a novel dense attention in the feature extraction module, enabling the network to understand and leverage inter-layer information. Our experiments demonstrate a marked improvement in fusion quality with our proposed method.

Feature-Level Fusion of Infrared Image and Visible Light Image Based on Two-Dimensional Discrete Wavelet Transform and High-Pass Filtering

Fusion of infrared and visual images through multiscale hybrid unidirectional total variation

Fusion Of Infrared And Visible Light Images Based On Nonsubsampled Shearlet Transform

Fusion of Low-Quality Visible and Infrared Images Based on Multi-Level Latent Low-Rank Representation Joint with Retinex Enhancement and Multi-Visual Weight Information

Two-scale Image Fusion of Visible and Infrared Images Using Guided Filter

Infrared and Visible Image Fusion Using Dual-Tree Complex Wavelet Transform and Convolutional Sparse Representation

Infrared and Visible Image Fusion Algorithm Based on Double-Domain Transform Filter and Contrast Transform Feature Extraction

Infrared and Visual Image Fusion Based on a Local-Extrema-Driven Image Filter

Infrared and visual image fusion enhancement by dual-transform

Fusion Research of Visible and Infrared Images Based on IHS Transform and Regional Variance Wavelet Transform

Visible-Infrared Image Fusion Based on Double- Density Wavelet and Thermal Exchange Optimization

Infrared and Visible Image Fusion with Hybrid Image Filtering

Fusion of Infrared and Visible Images Based on Wavelet Frame

Infrared and Visible Image Fusion Based on Filtering Enhancement

An infrared and visible image fusion method based on deep learning

Multi-Level Image Fusion and Enhancement for Target Detection

Infrared–Visible Image Fusion through Feature-Based Decomposition and Domain Normalization

Fusion of Infrared and Visible Image with Wavelet on Interval

Image fusion using lifting wavelet transform with human visual features

A fast multi-resolution image fusion method based on visual features

Infrared and Visible Image Fusion Based on Feature Energy