Abstract:To obtain fused images with excellent contrast, distinct target edges, and well-preserved details, we propose an adaptive image fusion network called the adjacent feature shuffle-fusion network (AFSFusion). The proposed network adopts a UNet-like architecture and incorporates key refinements to enhance network architecture and loss functions. Regarding the network architecture, the proposed two-branch adjacent feature fusion module, called AFSF, expands the number of channels to fuse the feature channels of several adjacent convolutional layers in the first half of the AFSFusion, enhancing its ability to extract, transmit, and modulate feature information. We replace the original rectified linear unit (ReLU) with leaky ReLU to alleviate the problem of gradient disappearance and add a channel shuffling operation at the end of AFSF to facilitate information interaction capability between features. Concerning loss functions, we propose an adaptive weight adjustment (AWA) strategy to assign weight values to the corresponding pixels of the infrared (IR) and visible images in the fused images, according to the VGG16 gradient feature response of the IR and visible images. This strategy efficiently handles different scene contents. After normalization, the weight values are used as weighting coefficients for the two sets of images. The weighting coefficients are applied to three loss items simultaneously: mean square error (MSE), structural similarity (SSIM), and total variation (TV), resulting in clearer objects and richer texture detail in the fused images. We conducted a series of experiments on several benchmark databases, and the results demonstrate the effectiveness of the proposed network architecture and the superiority of the proposed network compared to other state-of-the-art fusion methods. It ranks first in several objective metrics, showing the best performance and exhibiting sharper and richer edges of specific targets, which is more in line with human visual perception. The remarkable enhancement in performance is ascribed to the proposed AFSF module and AWA strategy, enabling balanced feature extraction, fusion, and modulation of image features throughout the process.

A2RNet: Adversarial Attack Resilient Network for Robust Infrared and Visible Image Fusion

MRF3Net: Infrared Small Target Detection Using Multi-Receptive Field Perception and Effective Feature Fusion

IVJDN: an End-to-End Network for Joint Infrared and Visible Image Fusion and Detection

RITFusion: Reinforced Interactive Transformer Network for Infrared and Visible Image Fusion

IAIFNet: An Illumination-Aware Infrared and Visible Image Fusion Network

Adaptive Oriented Adversarial Attacks on Visible and Infrared Image Fusion Models

RAN: Infrared and Visible Image Fusion Network Based on Residual Attention Decomposition

Infrared and Visible Image Fusion Based on Adversarial Feature Extraction and Stable Image Reconstruction

RADFNet: an Infrared and Visible Image Fusion Framework Based on Distributed Network.

Res2NetFuse: A Novel Res2Net-based Fusion Method for Infrared and Visible Images

AFSFusion: an Adjacent Feature Shuffle Combination Network for Infrared and Visible Image Fusion

RDCa-Net: Residual Dense Channel Attention Symmetric Network for Infrared and Visible Image Fusion

DAF-Net: A Dual-Branch Feature Decomposition Fusion Network with Domain Adaptive for Infrared and Visible Image Fusion

ReCoNet: Recurrent Correction Network for Fast and Efficient Multi-modality Image Fusion.

VIF-Net: an Unsupervised Framework for Infrared and Visible Image Fusion

PAIF: Perception-Aware Infrared-Visible Image Fusion for Attack-Tolerant Semantic Segmentation

DDFNet-A: Attention-Based Dual-Branch Feature Decomposition Fusion Network for Infrared and Visible Image Fusion

Infrared and Visible Image Fusion via Interactive Compensatory Attention Adversarial Learning

LRRNet: A Novel Representation Learning Guided Fusion Network for Infrared and Visible Images

An interactive deep model combined with Retinex for low-light visible and infrared image fusion