Abstract:Medical image fusion is important in the field of clinical diagnosis because it can improve the availability of information contained in images. Magnetic Resonance Imaging (MRI) provides excellent anatomical details as well as functional information on regional changes in physiology, hemodynamics, and tissue composition. In contrast, although the spatial resolution of Positron Emission Tomography (PET) provides is lower than that an MRI, PET is capable of depicting the tissue's molecular and pathological activities that are not available from MRI. Fusion of MRI and PET may allow us to combine the advantages of both imaging modalities and achieve more precise localization and characterization of abnormalities. Previous image fusion algorithms, based on the estimation theory, assume that all distortions follow Gaussian distribution and are therefore susceptible to the model mismatch problem. To overcome this mismatch problem, we propose a new image fusion method with multi-resolution and nonparametric density models (MRNDM). The RGB space registered from the source multi-modal medical images is first transformed into a generalized intensity-hue-saturation space (GIHS), and then is decomposed into the low- and high-frequency components using the non-subsampled contourlet transform (NSCT). Two different fusion rules, which are based on the nonparametric density model and the theory of variable-weight, are developed and used to fuse low- and high-frequency coefficients. The fused images are constructed by performing the inverse of the NSCT operation with all composite coefficients. Our experimental results demonstrate that the quality of images fused from PET and MRI brain images using our proposed method MRNDM is higher than that of those fused using six previous fusion methods.

MRI-ultrasound Fusion Based on Magnetic Microbubble Contrast Agent

Image Fusion of CT and MR with Sparse Representation in NSST Domain

Magnetic Microbubble-Mediated Ultrasound-Mri Registration Based on Robust Optical Flow Model.

MRI-ultrasound Registration Based on Dual Modality Contrast Agent

MRI and PET image fusion using the nonparametric density model and the theory of variable-weight

MRI enhancement based on visual-attention by adaptive contrast adjustment and image fusion

High-Quality Fusion and Visualization for MR-PET Brain Tumor Images via Multi-Dimensional Features

CT and MRI Image Fusion Based on Multiscale Decomposition Method and Hybrid Approach.

An Efficient Fusion Algorithm Combining Feature Extraction and Variational Optimization for CT and MR Images

HID: The Hybrid Image Decomposition Model for MRI and CT Fusion

[CT and MRI fusion based on generative adversarial network and convolutional neural networks under image enhancement].

MRI and PET/SPECT fusion with pseudo spatial frequency in local laplacian filter domain

Medical Image Fusion Based on Variational and Nonlinear Structure Tensor

Fusion of Color Doppler and Magnetic Resonance Images of the Heart

Multiple emulsion microbubbles for ultrasound imaging

30Mhz High-Frequency Contrast-Enhanced Ultrasound and Super-Resolution Imaging Using Long-Lasting Microbubbles

Cross-contrast mutual fusion network for joint MRI reconstruction and super-resolution

CT and MRI image fusion algorithm based on hybrid l 0 l 1 layer decomposing and two-dimensional variation transform

MRI/CT Fusion Based on Latent Low Rank Representation and Gradient Transfer

US \& MRI Image Fusion Based on Markerless Skin Registration

Image fusion for following-up brain tumor evolution.