Abstract:Medical image fusion integrates image features of different modalities to provide comprehensive information for clinical diagnosis, treatment planning, and image-guided surgery. The information of the fused image is richer and clearer, which makes up for the defect of the single-mode medical image and retains the characteristic information of the source image. This paper proposes a novel multi-modality medical image fusion method based on gray medical images and color medical images. In the proposed method, the nonsubsampled shearlet transform (NSST) method is first used to decompose the source image into a low frequency sub-band and several high frequency sub-bands. The improved sparse representation is utilized to fuse the low frequency sub-band, which can remove the detail features through the sobel operator and the guided filter to improve the ability to preserve energy effectively. Meanwhile, the high frequency sub-bands are fused by a pulse coupled neural network (PCNN) based on edge preservation. This method fully considers the imaging characteristics of different medical modalities, which can process edge information well and process image details better. Finally, the fused low frequency sub-band and high frequency sub-bands are inversely transformed to obtain the final fused image. Seven different categories of medical images and seven fusion methods are used to verify the effectiveness of the proposed method. In addition, the medical images of three different modalities are merged to testify the influence of the fusion sequence. The experimental results show that the proposed method is superior to existing state-of-art methods in subjective visual performance and objective evaluation.

Medical Image Fusion Method Based on Coupled Neural P Systems in Nonsubsampled Shearlet Transform Domain

Image Fusion of CT and MR with Sparse Representation in NSST Domain

Medical Image Fusion with Parameter-Adaptive Pulse Coupled Neural Network in Nonsubsampled Shearlet Transform Domain

Multi-modal medical image fusion using improved dual-channel PCNN

Medical Image Fusion Via PCNN Based on Edge Preservation and Improved Sparse Representation in NSST Domain

Medical Image Fusion Based on Adaptive Pulse Coupled Neural Networks and Nonsubsampled Contourlet Transform

Multi-focus image fusion approach based on CNP systems in NSCT domain

A novel fusion method based on dynamic threshold neural P systems and nonsubsampled contourlet transform for multi-modality medical images

Medical Image Fusion Using Non-Subsampled Shearlet Transform And Improved Pcnn

Multi-sensor image fusion by NSCT-PCNN transform

Medical Image Fusion Using the PCNN Based on IQPSO in NSST Domain

Multimodal Sensor Medical Image Fusion Based on Nonsubsampled Shearlet Transform and S-PCNNs in HSV Space

Feature-Motivated Simplified Adaptive PCNN-Based Medical Image Fusion Algorithm in NSST Domain

A Medical Image Fusion Method Based on Convolutional Neural Networks

Multimodal Medical Image Fusion Framework Based on Simplified PCNN in Nonsubsampled Contourlet Transform Domain.

Medical Image Fusion Based on NonSubsampled Shearlet Transform and Parameter-Adaptive Pulse-Coupled Neural Network

Multi-modality Anatomical and Functional Medical Image Fusion Based on Simplified-spatial Frequency-pulse Coupled Neural Networks and Region Energy-weighted Average Strategy in Non-sub Sampled Contourlet Transform Domain.

Technique for Image Fusion Based on Nonsubsampled Shearlet Transform and Improved Pulse-Coupled Neural Network

Multimodal medical image fusion with convolution sparse representation and mutual information correlation in NSST domain

A Novel Medical Image Fusion Approach Based on Nonsubsampled Shearlet Transform

Multimodal Medical Image Fusion Based on Nonsubsampled Contourlet Transform Using Improved Pcnn