Abstract:This paper introduces a novel infrared and visible image fusion network to address the limitations of auto‐encoder fusion networks. In the designed network, the encoder employs a multi‐branch cascade structure with convolution kernels of different sizes to extract multi‐scale features, and the fusion layer incorporates a non‐local attention module alongside a spatial feature fusion strategy for both global and local feature fusion. Comparative experiments on the TNO and MSRS datasets demonstrate that the proposed method outperforms other state‐of‐the‐art fusion approaches. In recent years, research on infrared and visible image fusion has mainly focused on deep learning‐based approaches, particularly deep neural networks with auto‐encoder architectures. However, these approaches suffer from problems such as insufficient feature extraction capability and inefficient fusion strategies. Therefore, this paper introduces a novel image fusion network to address the limitations of infrared and visible image fusion networks with auto‐encoder architectures. In the designed network, the encoder employs a multi‐branch cascade structure, and these convolution branches with different kernel sizes provide the encoder with an adaptive receptive field to extract multi‐scale features. In addition, the fusion layer incorporates a non‐local attention module that is inspired by the self‐attention mechanism. With its global receptive field, this module is used to build a non‐local attention fusion network, which works together with the l1 ‐norm spatial fusion strategy to extract, split, filter, and fuse global and local features. Comparative experiments on the TNO and MSRS datasets demonstrate that the proposed method outperforms other state‐of‐the‐art fusion approaches.

Pedestrian detection-driven cascade network for infrared and visible image fusion

Transformer fusion and histogram layer multispectral pedestrian detection network

Fused DNN: A deep neural network fusion approach to fast and robust pedestrian detection

A Fast RetinaNet Fusion Framework for Multi-Spectral Pedestrian Detection

Infrared and Visible Image Fusion Based on a Two-Stage Class Conditioned Auto-Encoder Network.

Robust Pedestrian Detection Based on Multi-Spectral Image Fusion and Convolutional Neural Networks

Optimal Fusion-based Asymmetric Two-stream Networks for Multispectral Image Pedestrian Detection

An infrared and visible image fusion network based on multi‐scale feature cascades and non‐local attention

Pedestrian Detection Method Based on Two-Stage Fusion of Visible Light Image and Thermal Infrared Image

Pedestrian Detection Using Multi-Channel Visual Feature Fusion by Learning Deep Quality Model.

Multispectral Deep Neural Networks for Pedestrian Detection

Deep saliency detection-based pedestrian detection with multispectral multi-scale features fusion network

IPD-Net: Infrared Pedestrian Detection Network via Adaptive Feature Extraction and Coordinate Information Fusion

TS-Net: two-stream network based on multispectral feature fusion

Cross-modality feature fusion for night pedestrian detection

Deep Feature Fusion by Competitive Attention for Pedestrian Detection

A Multi-Stage Visible and Infrared Image Fusion Network Based on Attention Mechanism

DCFusion: A Dual-Frequency Cross-Enhanced Fusion Network for Infrared and Visible Image Fusion.

An end-to-end multi-scale network based on autoencoder for infrared and visible image fusion

Visible and Infrared Image Fusion Based on Attention and Multiscale Residuals