Abstract:Multi-focus image fusion can extract the focus regions from different source images and combine them into a fully clear image. Existing unsupervised methods typically use gradient information to measure the focus regions in images and generate a fusion weight map, but ordinary gradient operators are difficult to measure information accurately in regions with weaker textures. In addition, using only gradient information as a constraint cannot make the model fully distinguish all the focus regions in the image, which seriously restricts the clarity of the fusion image. To address these issues, a novel unsupervised multi-focus image fusion method is proposed in this paper. Specifically, a neighborhood information fusion network is designed to generate an initial fusion weight map. It can capture features within different neighborhood ranges at once, which enhances the information association between different regions. In addition, to further improve the feature extraction ability of the model in the regions with low texture information, a local difference evaluation loss function is proposed. It is combined with the gradient measure loss function to constrain the network. Finally, a fusion weight optimization module is proposed to improve the clarity of the fusion image in the repeated defocusing regions and overexposed regions of different source images, which redistributes the weights of different source images. The proposed fusion method is compared with advanced methods on three public multi-focus datasets. Experimental results indicate that the proposed method has achieved better performance in qualitative and quantitative aspects.

MFF-GAN: An unsupervised generative adversarial network with adaptive and gradient joint constraints for multi-focus image fusion

A generative adversarial network with adaptive constraints for multi-focus image fusion

Multi-focus images fusion via residual generative adversarial network

DDF-GAN: A Generative Adversarial Network with Dual-Discriminator for Multi-Focus Image Fusion

MFIF-GAN: A New Generative Adversarial Network for Multi-Focus Image Fusion

Fusion-UDCGAN: Multifocus Image Fusion via a U-Type Densely Connected Generation Adversarial Network

FuseGAN: Learning to fuse Multi-focus Image via Conditional Generative Adversarial Network

The Fusion of Multi-Focus Images Based on the Complex Shearlet Features-Motivated Generative Adversarial Network

Focus Relationship Perception for Unsupervised Multi-Focus Image Fusion.

Multi-Focus Image Fusion Based on Multi-Scale Generative Adversarial Network

A Deep Model for Multi-Focus Image Fusion Based on Gradients and Connected Regions

Gradient-based multi-focus image fusion method using convolution neural network

Siamese conditional generative adversarial network for multi-focus image fusion

A multi-focus image fusion network with local-global joint attention module

Learning to Fuse Multi-Focus Image via Convolutional Network Modeling

MCRD-Net: an Unsupervised Dense Network with Multi-Scale Convolutional Block Attention for Multi-Focus Image Fusion

Multi-Focus Image Fusion Based on Multi-Scale Gradients and Image Matting

Multi-focus Image Fusion Via Gradient Guidance Progressive Network.

Multi-focus Image Fusion with Joint Guided Image Filtering

Robust Multi-Focus Image Fusion Using Focus Property Detection and Deep Image Matting.

A Deep and Supervised Atrous Convolutional Model for Multi-Focus Image Fusion