Abstract:Infrared–visible image fusion is valuable across various applications due to the complementary information that it provides. However, the current fusion methods face challenges in achieving high-quality fused images. This paper identifies a limitation in the existing fusion framework that affects the fusion quality: modal differences between infrared and visible images are often overlooked, resulting in the poor fusion of the two modalities. This limitation implies that features from different sources may not be consistently fused, which can impact the quality of the fusion results. Therefore, we propose a framework that utilizes feature-based decomposition and domain normalization. This decomposition method separates infrared and visible images into common and unique regions. To reduce modal differences while retaining unique information from the source images, we apply domain normalization to the common regions within the unified feature space. This space can transform infrared features into a pseudo-visible domain, ensuring that all features are fused within the same domain and minimizing the impact of modal differences during the fusion process. Noise in the source images adversely affects the fused images, compromising the overall fusion performance. Thus, we propose the non-local Gaussian filter. This filter can learn the shape and parameters of its filtering kernel based on the image features, effectively removing noise while preserving details. Additionally, we propose a novel dense attention in the feature extraction module, enabling the network to understand and leverage inter-layer information. Our experiments demonstrate a marked improvement in fusion quality with our proposed method.

Infrared and Visible Images Fusion by Using Sparse Representation and Guided Filter

Fusion of infrared and visual images through multiscale hybrid unidirectional total variation

Fusion of Visible and Infrared Images Using Saliency Analysis and Detail Preserving Based Image Decomposition

Fusion Of Infrared And Visible Light Images Based On Nonsubsampled Shearlet Transform

Infrared and visible image fusion method based on saliency detection and target-enhancement

Fusion of Low-Quality Visible and Infrared Images Based on Multi-Level Latent Low-Rank Representation Joint with Retinex Enhancement and Multi-Visual Weight Information

Infrared and Visible Image Fusion via Sparse Representation and Guided Filtering in Laplacian Pyramid Domain

Fusion of Infrared and Visible Images Via Multi-Layer Convolutional Sparse Representation

Infrared and Visible Image Fusion with Hybrid Image Filtering

Infrared and visible image fusion based on edge-preserving filter and weighted least square optimization

Two-scale Image Fusion of Visible and Infrared Images Using Guided Filter

Infrared and visible image fusion based on domain transform filtering and sparse representation

An Effective Infrared and Visible Image Fusion Approach via Rolling Guidance Filtering and Gradient Saliency Map

Infrared and Visual Image Fusion Based on a Local-Extrema-Driven Image Filter

Multi-Scale Fusion of Stretched Infrared and Visible Images

Infrared and Visible Image Fusion Based on Filtering Enhancement

Infrared and visible image fusion algorithm based on spatial domain and image features

Infrared–Visible Image Fusion through Feature-Based Decomposition and Domain Normalization

An infrared and visible image fusion algorithm based on ResNet-152

Infrared and Visible Image Fusion Using Dual-Tree Complex Wavelet Transform and Convolutional Sparse Representation

Infrared and Visible Image Fusion Algorithm Based on Double-Domain Transform Filter and Contrast Transform Feature Extraction