Abstract:This paper introduces a novel infrared and visible image fusion network to address the limitations of auto‐encoder fusion networks. In the designed network, the encoder employs a multi‐branch cascade structure with convolution kernels of different sizes to extract multi‐scale features, and the fusion layer incorporates a non‐local attention module alongside a spatial feature fusion strategy for both global and local feature fusion. Comparative experiments on the TNO and MSRS datasets demonstrate that the proposed method outperforms other state‐of‐the‐art fusion approaches. In recent years, research on infrared and visible image fusion has mainly focused on deep learning‐based approaches, particularly deep neural networks with auto‐encoder architectures. However, these approaches suffer from problems such as insufficient feature extraction capability and inefficient fusion strategies. Therefore, this paper introduces a novel image fusion network to address the limitations of infrared and visible image fusion networks with auto‐encoder architectures. In the designed network, the encoder employs a multi‐branch cascade structure, and these convolution branches with different kernel sizes provide the encoder with an adaptive receptive field to extract multi‐scale features. In addition, the fusion layer incorporates a non‐local attention module that is inspired by the self‐attention mechanism. With its global receptive field, this module is used to build a non‐local attention fusion network, which works together with the l1 ‐norm spatial fusion strategy to extract, split, filter, and fuse global and local features. Comparative experiments on the TNO and MSRS datasets demonstrate that the proposed method outperforms other state‐of‐the‐art fusion approaches.

Infrared-visible Image Fusion Based on Regional Attention Auto-Encoder

An Infrared and Visible Image Fusion Framework Based on Dual Scale Decomposition and Learnable Attention Fusion Strategy

Infrared and Visible Image Fusion Based on a Two-Stage Class Conditioned Auto-Encoder Network.

Advancing infrared and visible image fusion with an enhanced multiscale encoder and attention-based networks

An infrared and visible image fusion network based on multi‐scale feature cascades and non‐local attention

Visible and Infrared Image Fusion Based on Attention and Multiscale Residuals

Multi-sensor Image Fusion Based on Regional Characteristics

Multiscale Channel Attention Network for Infrared and Visible Image Fusion.

A Fusion Algorithm for Infrared and Visible Images Based on RDU-PCNN and ICA-bases in NSST Domain

Infrared and Visible Image Fusion Based on Variational Auto-Encoder and Infrared Feature Compensation

Interactive residual coordinate attention and contrastive learning for infrared and visible image fusion in triple frequency bands

When Image Decomposition Meets Deep Learning: A Novel Infrared and Visible Image Fusion Method

Infrared and visible image fusion method based on visual saliency objects and fuzzy region attributes

Infrared and Visible Image Fusion Method Based on Hierarchical Attention Mechanism

An end-to-end multi-scale network based on autoencoder for infrared and visible image fusion

A robust infrared and visible image fusion framework via multi-receptive-field attention and color visual perception

An Efficient Method for Infrared and Visual Images Fusion Based on Visual Attention Technique.

Multi-scale unsupervised network for infrared and visible image fusion based on joint attention mechanism

MEEAFusion: Multi-Scale Edge Enhancement and Joint Attention Mechanism Based Infrared and Visible Image Fusion

Infrared and visible image fusion with entropy-based adaptive fusion module and mask-guided convolutional neural network

Fusion of Infrared and Visible Images based on Spatial-Channel Attentional Mechanism