Abstract:Abstract Infrared and visible image fusion aims to generate synthetic images including salient targets and abundant texture details. However, traditional techniques and recent deep learning-based approaches have faced challenges in preserving prominent structures and fine-grained features. In this study, we propose a lightweight infrared and visible image fusion network utilizing multi-scale attention modules and hybrid dilated convolutional blocks to preserve significant structural features and fine-grained textural details. First, we design a hybrid dilated convolutional block with different dilation rates that enable the extraction of prominent structure features by enlarging the receptive field in the fusion network. Compared with other deep learning methods, our method can obtain more high-level semantic information without piling up a large number of convolutional blocks, effectively improving the ability of feature representation. Second, distinct attention modules are designed to integrate into different layers of the network to fully exploit contextual information of the source images, and we leverage the total loss to guide the fusion process to focus on vital regions and compensate for missing information. Extensive qualitative and quantitative experiments demonstrate the superiority of our proposed method over state-of-the-art methods in both visual effects and evaluation metrics. The experimental results on public datasets show that our method can improve the entropy (EN) by 4.80%, standard deviation (SD) by 3.97%, correlation coefficient (CC) by 1.86%, correlations of differences (SCD) by 9.98%, and multi-scale structural similarity (MS_SSIM) by 5.64%, respectively. In addition, experiments with the VIFB dataset further indicate that our approach outperforms other comparable models.

An infrared and visible image fusion algorithm based on ResNet-152

Fusion of Visible and Infrared Images Using Saliency Analysis and Detail Preserving Based Image Decomposition

Detail preserved fusion of visible and infrared images using regional saliency extraction and multi-scale image decomposition

Fusion of Low-Quality Visible and Infrared Images Based on Multi-Level Latent Low-Rank Representation Joint with Retinex Enhancement and Multi-Visual Weight Information

Fusion Of Infrared And Visible Light Images Based On Nonsubsampled Shearlet Transform

Infrared and visible image fusion method based on saliency detection and target-enhancement

Fusion of Infrared and Visible Images Based on Three-Scale Decomposition and ResNet Feature Transfer

Infrared and visible image fusion with entropy-based adaptive fusion module and mask-guided convolutional neural network

Fusion of Infrared and Visible Images Via Multi-Layer Convolutional Sparse Representation

Infrared and visible image fusion algorithm based on spatial domain and image features

Infrared and Visible Image Fusion with Hybrid Image Filtering

Visible and Infrared Image Fusion Based on Attention and Multiscale Residuals

Infrared and Visible Image Fusion with ResNet and zero-phase component analysis

Infrared and Visible Image Fusion Based on Filtering Enhancement

Infrared and visible image fusion based on VPDE model and VGG network

Res2NetFuse: A Novel Res2Net-based Fusion Method for Infrared and Visible Images

Infrared and Visible Image Fusion with Convolutional Neural Networks.

Infrared and Visible Image Fusion Method Based on Hierarchical Attention Mechanism

Infrared and visible image fusion in a rolling guided filtering framework based on deep feature extraction

Multi-scale attention-based lightweight network with dilated convolutions for infrared and visible image fusion

Infrared–Visible Image Fusion through Feature-Based Decomposition and Domain Normalization