Abstract:Existing infrared and visible image fusion algorithms have problems with reduced saliency for infrared targets and a lack of background texture information. To address this problem, a generative adversarial network for image fusion based on an attention mechanism is proposed in this study. This network consists of a generator, a discriminator, and an adaptive decision block. The generator employs a DenseNet-based cascade approach, which substantially lowers the information loss during the convolution process. A Markovian discriminator, unlike global discriminators, is embedded in the network. It divides images into patches, causing the network to focus on local regions and distinguishing the generated images as a whole. In addition, an adaptive decision block is included in the model to build an intensity dynamic mapping mechanism. To guide the computation for a certain content loss, a weighted map is created based on the intensity information of infrared images. Unlike the other loss functions, the weighted parameters of each component of the loss function are adaptively evaluated. To demonstrate the effectiveness of the proposed method, qualitative and quantitative experiments on TNO and RoadScene datasets are carried out. The experimental findings suggest that the proposed technique retains more significant characteristics in source images and produces fused images with rich texture details. Furthermore, the system noise resistance of each approach is examined. Under the condition of different noise, the fusion results of our approach still exhibit less distortion and a higher peak signal-to-noise ratio when compared to other state-of-the-art fusion methods.

Infrared and Visible Image Fusion Based on Edge-Preserving and Attention Generative Adversarial Network

Research on Fusion Algorithm of Infrared and Visible Image Based on Generative Adversarial Network and Attention Mechanism

A Generative Adversarial Network for infrared and visible image fusion using adaptive dense generator and Markovian discriminator

Multi-Detail Significant Target Attention Generation Adversarial Network for Infrared and Visible Image Fusion

Infrared and Visible Image Fusion via Interactive Compensatory Attention Adversarial Learning

An Infrared and Visible Image Fusion Method Based on Adaptive Weight Learning

Infrared And Visible Image Fusion Method Based On Dual-Channel Generative Adversarial Network

Luminance-Preserving Visible and Near-Infrared Image Fusion Network with Edge Guidance

A Generative Adversarial Network with Dual Discriminators for Infrared and Visible Image Fusion Based on Saliency Detection

Multigrained Attention Network for Infrared and Visible Image Fusion

An attention-guided and wavelet-constrained generative adversarial network for infrared and visible image fusion

Infrared and Visible Image Fusion Using a Generative Adversarial Network with a Dual-Branch Generator and Matched Dense Blocks

Infrared and visible image fusion with entropy-based adaptive fusion module and mask-guided convolutional neural network

FusionGAN: A Generative Adversarial Network for Infrared and Visible Image Fusion.

A Novel Infrared and Visible Image Fusion Algorithm Based on Global Information-Enhanced Attention Network

Weakly Supervised Infrared and Visible Image Fusion Based on Attention Mechanism

Fusion of Infrared and Visible Images Based on Improved Generative Adversarial Networks

Hierarchical Fusion of Infrared and Visible Images Based on Channel Attention Mechanism and Generative Adversarial Networks

AT-GAN: A generative adversarial network with attention and transition for infrared and visible image fusion

An Infrared and Visible Image Fusion Framework Based on Dual Scale Decomposition and Learnable Attention Fusion Strategy

Infrared and Visible Image Fusion Based on Filtering Enhancement