Abstract:The aim of multimodal medical image fusion is to extract information from different modal images into a single one so that the single fusion image contains the salient features of the source images to the maximum extent. Different medical imaging modalities such as CT and MRI are presented as different visual morphology, which often show different complementary salient features in clinical diagnosis. According to this characteristic, in order to fuse different salient features of multimodal medical images into a single image and provide a new dimension of information for clinical diagnosis to improve the diagnosis accuracy, an improved image fusion algorithm based on visual salience detection is proposed in this paper. The visual salience of two registered source images is calculated by the GBVS algorithm, and the low-frequency and high-frequency sub-bands are obtained by decomposing the source images in NSST domain. For the low-frequency sub-bands, fuzzy logic system is used to obtain the respective weights of the fused low-frequency sub-band with the local energy and GBVS graph as input. For the high-frequency sub-bands, the NSML values of each sub-band are calculated and compared to obtain the fused high-frequency sub-band. The final fused image is obtained by the inverse NSST transformation. In addition, PSO algorithm is used to optimize the membership function of fuzzy logic system for better adaption to medical images and feature extraction. By applying this multimodal medical image fusion method, the visual quality of the image is effectively improved and the salient features of tissues are preserved well. Experiments on fusion of grayscale, color and ultrasound multimodal medical images show that the proposed method has advantages on retention of image salient features. Compared with other models, the fused image obtained by the proposed method has higher objective indexes with clearer edge contour, higher overall contrast, and no ringing effect and artifacts.

Medical Image Fusion Using Optimal Feature Selection Methods Based on Second Generation Contourlet Transform

Image Fusion of CT and MR with Sparse Representation in NSST Domain

Multimodal Medical Image Fusion in Extended Contourlet Transform Domain

Detail-Enhanced Medical Image Fusion in NSCT Domain

Medical image fusion based on improved multi-scale morphology gradient-weighted local energy and visual saliency map

Log-Gabor energy based multimodal medical image fusion in NSCT domain

A new method of medical image fusion based on nonsubsampled contourlet transform

Multimodal Medical Image Fusion in Modified Sharp Frequency Localized Contourlet Domain

Medical Image Fusion for Multiple Diseases Features Enhancement

Optimized multimodal medical image fusion framework using multi-scale geometric and multi-resolution geometric analysis

A Medical Image Fusion Method Based on SIFT and Deep Convolutional Neural Network in the SIST Domain

Multimodal medical image fusion using gradient domain guided filter random walk and side window filtering in framelet domain

A Novel GA-Based Optimized Approach for Regional Multimodal Medical Image Fusion With Superpixel Segmentation

Fusion of Medical Images Based on Salient Features Extraction by PSO Optimized Fuzzy Logic in NSST Domain

Computational Effective Multimodal Medical Image Fusion in NSCT Domain

An Efficient Fusion Algorithm Combining Feature Extraction and Variational Optimization for CT and MR Images

An Efficient Dwt And Intuitionistic Fuzzy Based Multimodality Medical Image Fusion

Medical image fusion via discrete stationary wavelet transform and an enhanced radial basis function neural network

Medical Image Fusion by Multi-resolution Analysis of Wavelets Transform

An Intelligent Multimodal Medical Image Fusion Model Based on Improved Fast Discrete Curvelet Transform and Type-2 Fuzzy Entropy

Medical Image Fusion via an Effective Wavelet-Based Approach