Abstract:In cell and molecular biology, the fusion of green fluorescent protein (GFP) and phase contrast (PC) images aims to generate a composite image, which can simultaneously display the functional information in the GFP image related to the molecular distribution of biological living cells and the structural information in the PC image such as nucleus and mitochondria. In this paper, we propose a detail preserving cross network (DPCN), which consists of a structural-guided functional feature extraction branch (SFFEB), a functional-guided structural feature extraction branch (FSFEB) and a detail preserving module (DPM), to address the GFP and PC image fusion issue. Unlike traditional parallel multi-branch architectures used for multiple inputs, the SFFEB and the FSFEB are interacted via a cross manner to fuse the functional information from the GFP image and the structural information from the PC image more adequately. Moreover, the DPM is composed of eight multi-scale convolutional blocks (MSCBs) associated with short, medium, and long skip connections to further extract the detail information from the source images. Experimental results on the popular Arabidopsis thaliana cell database demonstrate that the proposed method outperforms the state-of-the-art methods in terms of both qualitative and quantitative evaluations. The proposed method is also extended to deal with the functional and structural image fusion issue in medical imaging, and the promising results obtained exhibit its good generalizability. The code of our method is available at https://github.com/yuliu316316/DPCN-Fusion.

A Phase Congruency‐based Green Fluorescent Protein and Phase Contrast Image Fusion Method in Nonsubsampled Shearlet Transform Domain

Fusion of GFP and phase contrast images with complex shearlet transform and Haar wavelet-based energy rule.

Fusion Of Infrared And Visible Light Images Based On Nonsubsampled Shearlet Transform

A Fusion Algorithm for GFP Images and Phase-Contrast Images Based on Contourlet Transform

Green Fluorescent Protein and Phase-Contrast Image Fusion Via Generative Adversarial Networks

Fusion of mis-registered GFP and phase contrast images with convolutional sparse representation and adaptive region energy rule.

Green Fluorescent Protein and Phase Contrast Image Fusion Via Detail Preserving Cross Network

A fusion algorithm for infrared and visible based on guided filtering and phase congruency in NSST domain

Fusion of GFP Fluorescent and Phase Contrast Images Using Stationary Wavelet Transform Based Variable-Transparency Method

Hybrid multi-scale and multi-level fusion algorithm for biological cell image

Green Fluorescent Protein and Phase Contrast Image Fusion via Dual Attention Residual Network

A Fusion Algorithm for Gfp Image and Phase Contrast Image of Arabidopsis Cell Based on Sfl-Contourlet Transform

Green Fluorescent Protein and Phase Contrast Image Fusion Via Spectral TV Filter-Based Decomposition.

Novel fusion method for visible light and infrared images based on NSST–SF–PCNN

Technique for Image Fusion Based on Nonsubsampled Shearlet Transform and Improved Pulse-Coupled Neural Network

Medical Image Fusion with Parameter-Adaptive Pulse Coupled Neural Network in Nonsubsampled Shearlet Transform Domain

Infrared and Visible Image Fusion Using Intensity Transfer and Phase Congruency in Nonsubsampled Shearlet Transform Domain

Infrared and visible image fusion based on NSST and phase consistency adaptive DUAL channel PCNN

Fusion of Infrared and Visible Light Images Based on Improved Adaptive Dual-Channel Pulse Coupled Neural Network

Biological image fusion using a NSCT based variable-weight method

A Novel Infrared and Visible Image Information Fusion Method Based on Phase Congruency and Image Entropy