Abstract:Medical image fusion integrates image features of different modalities to provide comprehensive information for clinical diagnosis, treatment planning, and image-guided surgery. The information of the fused image is richer and clearer, which makes up for the defect of the single-mode medical image and retains the characteristic information of the source image. This paper proposes a novel multi-modality medical image fusion method based on gray medical images and color medical images. In the proposed method, the nonsubsampled shearlet transform (NSST) method is first used to decompose the source image into a low frequency sub-band and several high frequency sub-bands. The improved sparse representation is utilized to fuse the low frequency sub-band, which can remove the detail features through the sobel operator and the guided filter to improve the ability to preserve energy effectively. Meanwhile, the high frequency sub-bands are fused by a pulse coupled neural network (PCNN) based on edge preservation. This method fully considers the imaging characteristics of different medical modalities, which can process edge information well and process image details better. Finally, the fused low frequency sub-band and high frequency sub-bands are inversely transformed to obtain the final fused image. Seven different categories of medical images and seven fusion methods are used to verify the effectiveness of the proposed method. In addition, the medical images of three different modalities are merged to testify the influence of the fusion sequence. The experimental results show that the proposed method is superior to existing state-of-art methods in subjective visual performance and objective evaluation.

A Novel Fusion Framework Based on Adaptive PCNN in NSCT Domain for Whole-Body PET and CT Images.

Image Fusion of CT and MR with Sparse Representation in NSST Domain

An Improved Medical Image Fusion Method Based on PCNN in NSST Domain

A Novel Fusion Method Using NSCT and PCNN

PET/CT Image Pixel-Level Fusion Algorithm Based on NSCT and Compressed Sensing

Medical Image Fusion Based on Adaptive Pulse Coupled Neural Networks and Nonsubsampled Contourlet Transform

Multi-modality Anatomical and Functional Medical Image Fusion Based on Simplified-spatial Frequency-pulse Coupled Neural Networks and Region Energy-weighted Average Strategy in Non-sub Sampled Contourlet Transform Domain.

Multi-sensor image fusion by NSCT-PCNN transform

Medical Image Fusion with Parameter-Adaptive Pulse Coupled Neural Network in Nonsubsampled Shearlet Transform Domain

Feature-Motivated Simplified Adaptive PCNN-Based Medical Image Fusion Algorithm in NSST Domain

An Image Fusion Method Based on NSCT and Dual-channel PCNN Model

Fusion Algorithm of Infrared and Visible Images Based on NSCT and PCNN

A New Pulse Coupled Neural Network (PCNN) for Brain Medical Image Fusion Empowered by Shuffled Frog Leaping Algorithm.

Image Fusion Algorithm Based on Spatial Frequency-Motivated Pulse Coupled Neural Networks in Nonsubsampled Contourlet Transform Domain

Image Fusion Technique Based on Non-Subsampled Contourlet Transform and Adaptive Unit-Fast-linking Pulse-Coupled Neural Network

A Novel Image Fusion Algorithm Using an NSCT and a PCNN with Digital Filtering

Multimodal Medical Image Fusion Framework Based on Simplified PCNN in Nonsubsampled Contourlet Transform Domain.

Medical Image Fusion Using Non-Subsampled Shearlet Transform And Improved Pcnn

A novel multi-focus image fusion method using PCNN in nonsubsampled contourlet transform domain

Medical Image Fusion Via PCNN Based on Edge Preservation and Improved Sparse Representation in NSST Domain

A Novel Multi-focus Image Fusion Method Using Pulse Coupled Neural Network in Nonsubsampled Contourlet Transform Domain