Abstract:Medical image fusion integrates image features of different modalities to provide comprehensive information for clinical diagnosis, treatment planning, and image-guided surgery. The information of the fused image is richer and clearer, which makes up for the defect of the single-mode medical image and retains the characteristic information of the source image. This paper proposes a novel multi-modality medical image fusion method based on gray medical images and color medical images. In the proposed method, the nonsubsampled shearlet transform (NSST) method is first used to decompose the source image into a low frequency sub-band and several high frequency sub-bands. The improved sparse representation is utilized to fuse the low frequency sub-band, which can remove the detail features through the sobel operator and the guided filter to improve the ability to preserve energy effectively. Meanwhile, the high frequency sub-bands are fused by a pulse coupled neural network (PCNN) based on edge preservation. This method fully considers the imaging characteristics of different medical modalities, which can process edge information well and process image details better. Finally, the fused low frequency sub-band and high frequency sub-bands are inversely transformed to obtain the final fused image. Seven different categories of medical images and seven fusion methods are used to verify the effectiveness of the proposed method. In addition, the medical images of three different modalities are merged to testify the influence of the fusion sequence. The experimental results show that the proposed method is superior to existing state-of-art methods in subjective visual performance and objective evaluation.

Multimodal Medical Image Fusion Based on Multichannel Coupled Neural P Systems and Max-Cloud Models in Spectral Total Variation Domain

Image Fusion of CT and MR with Sparse Representation in NSST Domain

Multimodal medical image fusion based on visual saliency map and multichannel dynamic threshold neural P systems in sub-window variance filter domain

Multimodal Medical Image Fusion Based on the Spectral Total Variation and Local Structural Patch Measurement

Multimodal Medical Image Fusion Based on Joint Bilateral Filter and Local Gradient Energy.

Medical Image Fusion Via PCNN Based on Edge Preservation and Improved Sparse Representation in NSST Domain

Multimodal medical image fusion based on interval gradients and convolutional neural networks

Multimodal Sensor Medical Image Fusion Based on Nonsubsampled Shearlet Transform and S-PCNNs in HSV Space

Multimodal medical image fusion based on IHS and PCA

Medical Image Fusion Based on Adaptive Pulse Coupled Neural Networks and Nonsubsampled Contourlet Transform

Multimodal medical image fusion with convolution sparse representation and mutual information correlation in NSST domain

Multimodal Medical Image Fusion Based on Discrete Tchebichef Moments and Pulse Coupled Neural Network.

Multi-Modal Medical Image Fusion Based on FusionNet in YIQ Color Space

Multi-modal medical image fusion using improved dual-channel PCNN

Robust Spiking Cortical Model and Total-Variational Decomposition for Multimodal Medical Image Fusion

Multimodal Medical Image Fusion Based on Saliency Features Detection in NSST Domain

Medical Image Fusion with Parameter-Adaptive Pulse Coupled Neural Network in Nonsubsampled Shearlet Transform Domain

Multimodal medical image fusion in NSST domain with structural and spectral features enhancement

Multistage multimodal medical image fusion model using feature‐adaptive pulse coupled neural network

Medical Image Fusion Method Based on Coupled Neural P Systems in Nonsubsampled Shearlet Transform Domain

Medical image fusion based on improved multi-scale morphology gradient-weighted local energy and visual saliency map