Abstract:Infrared–visible image fusion is valuable across various applications due to the complementary information that it provides. However, the current fusion methods face challenges in achieving high-quality fused images. This paper identifies a limitation in the existing fusion framework that affects the fusion quality: modal differences between infrared and visible images are often overlooked, resulting in the poor fusion of the two modalities. This limitation implies that features from different sources may not be consistently fused, which can impact the quality of the fusion results. Therefore, we propose a framework that utilizes feature-based decomposition and domain normalization. This decomposition method separates infrared and visible images into common and unique regions. To reduce modal differences while retaining unique information from the source images, we apply domain normalization to the common regions within the unified feature space. This space can transform infrared features into a pseudo-visible domain, ensuring that all features are fused within the same domain and minimizing the impact of modal differences during the fusion process. Noise in the source images adversely affects the fused images, compromising the overall fusion performance. Thus, we propose the non-local Gaussian filter. This filter can learn the shape and parameters of its filtering kernel based on the image features, effectively removing noise while preserving details. Additionally, we propose a novel dense attention in the feature extraction module, enabling the network to understand and leverage inter-layer information. Our experiments demonstrate a marked improvement in fusion quality with our proposed method.

Infrared and Visible Image Fusion Based on Feature Energy

Fusion Of Infrared And Visible Light Images Based On Nonsubsampled Shearlet Transform

Infrared and visible image fusion method based on saliency detection and target-enhancement

Fusion of infrared and visual images through multiscale hybrid unidirectional total variation

Fusion of Visible and Infrared Images Using Saliency Analysis and Detail Preserving Based Image Decomposition

Infrared and Visible Image Fusion Based on NSCT and Fuzzy Logic

Fusion of Low-Quality Visible and Infrared Images Based on Multi-Level Latent Low-Rank Representation Joint with Retinex Enhancement and Multi-Visual Weight Information

Image fusion based on nonsubsampled contourlet transform for infrared and visible light image

A novel image fusion algorithm for infrared and visible light

Infrared and visible image fusion enhancement technology based on multi-scale directional analysis

Infrared and Visible Image Fusion Algorithm Based on Double-Domain Transform Filter and Contrast Transform Feature Extraction

Fusion of Infrared and Visible Light Images Based on Improved Adaptive Dual-Channel Pulse Coupled Neural Network

Infrared and Visible Images Fusion Using Visual Saliency and Dual-PCNN

Infrared and visible image fusion based on NSST and phase consistency adaptive DUAL channel PCNN

Infrared and Visible Image Fusion Method Based on Hierarchical Attention Mechanism

Infrared and Visible Image Fusion Using Dual-Tree Complex Wavelet Transform and Convolutional Sparse Representation

Infrared and Visible Image Fusion with Hybrid Image Filtering

Infrared and Visual Image Fusion Based on a Local-Extrema-Driven Image Filter

Novel fusion method for visible light and infrared images based on NSST–SF–PCNN

Combining Regional Energy and Intuitionistic Fuzzy Sets for Infrared and Visible Image Fusion

Infrared–Visible Image Fusion through Feature-Based Decomposition and Domain Normalization