Abstract:Medical image fusion integrates image features of different modalities to provide comprehensive information for clinical diagnosis, treatment planning, and image-guided surgery. The information of the fused image is richer and clearer, which makes up for the defect of the single-mode medical image and retains the characteristic information of the source image. This paper proposes a novel multi-modality medical image fusion method based on gray medical images and color medical images. In the proposed method, the nonsubsampled shearlet transform (NSST) method is first used to decompose the source image into a low frequency sub-band and several high frequency sub-bands. The improved sparse representation is utilized to fuse the low frequency sub-band, which can remove the detail features through the sobel operator and the guided filter to improve the ability to preserve energy effectively. Meanwhile, the high frequency sub-bands are fused by a pulse coupled neural network (PCNN) based on edge preservation. This method fully considers the imaging characteristics of different medical modalities, which can process edge information well and process image details better. Finally, the fused low frequency sub-band and high frequency sub-bands are inversely transformed to obtain the final fused image. Seven different categories of medical images and seven fusion methods are used to verify the effectiveness of the proposed method. In addition, the medical images of three different modalities are merged to testify the influence of the fusion sequence. The experimental results show that the proposed method is superior to existing state-of-art methods in subjective visual performance and objective evaluation.

Adaptive Weighted PET/SPECT and MR Medical Image Fusion Based on Nonsubsampled Shearlet Transform

Image Fusion of CT and MR with Sparse Representation in NSST Domain

Medical Image Fusion with Parameter-Adaptive Pulse Coupled Neural Network in Nonsubsampled Shearlet Transform Domain

Color Medical Image Fusion Using Non-subsampled Shearlet Transform

Multimodal Sensor Medical Image Fusion Based on Nonsubsampled Shearlet Transform and S-PCNNs in HSV Space

A Novel Medical Image Fusion Approach Based on Nonsubsampled Shearlet Transform

A fusion algorithm based on composite decomposition for PET and MRI medical images

Medical Image Fusion Via PCNN Based on Edge Preservation and Improved Sparse Representation in NSST Domain

MRI and PET/SPECT Image Fusion Based on Adaptive Weighted Guided Image Filtering

Medical image fusion based on improved multi-scale morphology gradient-weighted local energy and visual saliency map

Medical Image Fusion Based on Adaptive Pulse Coupled Neural Networks and Nonsubsampled Contourlet Transform

An Algorithm of Medical Image Fusion Based on Shearlet Transformation

Medical Image Fusion Based on NonSubsampled Shearlet Transform and Parameter-Adaptive Pulse-Coupled Neural Network

Adaptive Decomposition Method for Multi-Modal Medical Image Fusion.

Multi-modality Anatomical and Functional Medical Image Fusion Based on Simplified-spatial Frequency-pulse Coupled Neural Networks and Region Energy-weighted Average Strategy in Non-sub Sampled Contourlet Transform Domain.

A Fusion Algorithm for Medical Structural and Functional Images Based on Adaptive Image Decomposition

Medical Image Fusion Based on Pixel-Level Nonlocal Self-similarity Prior and Optimization.

Multimodal medical image fusion with convolution sparse representation and mutual information correlation in NSST domain

Multistage multimodal medical image fusion model using feature‐adaptive pulse coupled neural network

An Improved Medical Image Fusion Method Based on PCNN in NSST Domain

Medical Image Fusion Using Non-Subsampled Shearlet Transform And Improved Pcnn