Abstract:Multi-focus image fusion technologies compress different focus depth images into an image in which most objects are in focus. However, although existing image fusion techniques, including traditional algorithms and deep learning-based algorithms, can generate high-quality fused images, they need multiple images with different focus depths in the same field of view. This criterion may not be met in some cases where time efficiency is required or the hardware is insufficient. The problem is especially prominent in large-size whole slide images. This paper focused on the multi-focus image fusion of cytopathological digital slide images, and proposed a novel method for generating fused images from single-focus or few-focus images based on conditional generative adversarial network (GAN). Through the adversarial learning of the generator and discriminator, the method is capable of generating fused images with clear textures and large depth of field. Combined with the characteristics of cytopathological images, this paper designs a new generator architecture combining U-Net and DenseBlock, which can effectively improve the network's receptive field and comprehensively encode image features. Meanwhile, this paper develops a semantic segmentation network that identifies the blurred regions in cytopathological images. By integrating the network into the generative model, the quality of the generated fused images is effectively improved. Our method can generate fused images from only single-focus or few-focus images, thereby avoiding the problem of collecting multiple images of different focus depths with increased time and hardware costs. Furthermore, our model is designed to learn the direct mapping of input source images to fused images without the need to manually design complex activity level measurements and fusion rules as in traditional methods.

A generative adversarial network with adaptive constraints for multi-focus image fusion

MFF-GAN: An unsupervised generative adversarial network with adaptive and gradient joint constraints for multi-focus image fusion

Multi-focus images fusion via residual generative adversarial network

DDF-GAN: A Generative Adversarial Network with Dual-Discriminator for Multi-Focus Image Fusion

MFIF-GAN: A New Generative Adversarial Network for Multi-Focus Image Fusion

FuseGAN: Learning to fuse Multi-focus Image via Conditional Generative Adversarial Network

Fusion-UDCGAN: Multifocus Image Fusion via a U-Type Densely Connected Generation Adversarial Network

Multi-Focus Image Fusion Based on Multi-Scale Generative Adversarial Network

AMFNet: An attention-guided generative adversarial network for multi-model image fusion

The Fusion of Multi-Focus Images Based on the Complex Shearlet Features-Motivated Generative Adversarial Network

MEF-GAN: Multi-Exposure Image Fusion via Generative Adversarial Networks

FFusionCGAN: An end-to-end fusion method for few-focus images using conditional GAN in cytopathological digital slides

GANFuse: a Novel Multi-Exposure Image Fusion Method Based on Generative Adversarial Networks

AT-GAN: A generative adversarial network with attention and transition for infrared and visible image fusion

Siamese conditional generative adversarial network for multi-focus image fusion

A Generative Adversarial Network For Medical Image Fusion

A Deep Model for Multi-Focus Image Fusion Based on Gradients and Connected Regions

UIFGAN: an Unsupervised Continual-Learning Generative Adversarial Network for Unified Image Fusion

Image fusion based on generative adversarial network consistent with perception

Two-stream Maximal Feature Attention-guided Contrastive-learning GAN for Image Fusion