Abstract:Medical image fusion is important in the field of clinical diagnosis because it can improve the availability of information contained in images. Magnetic Resonance Imaging (MRI) provides excellent anatomical details as well as functional information on regional changes in physiology, hemodynamics, and tissue composition. In contrast, although the spatial resolution of Positron Emission Tomography (PET) provides is lower than that an MRI, PET is capable of depicting the tissue's molecular and pathological activities that are not available from MRI. Fusion of MRI and PET may allow us to combine the advantages of both imaging modalities and achieve more precise localization and characterization of abnormalities. Previous image fusion algorithms, based on the estimation theory, assume that all distortions follow Gaussian distribution and are therefore susceptible to the model mismatch problem. To overcome this mismatch problem, we propose a new image fusion method with multi-resolution and nonparametric density models (MRNDM). The RGB space registered from the source multi-modal medical images is first transformed into a generalized intensity-hue-saturation space (GIHS), and then is decomposed into the low- and high-frequency components using the non-subsampled contourlet transform (NSCT). Two different fusion rules, which are based on the nonparametric density model and the theory of variable-weight, are developed and used to fuse low- and high-frequency coefficients. The fused images are constructed by performing the inverse of the NSCT operation with all composite coefficients. Our experimental results demonstrate that the quality of images fused from PET and MRI brain images using our proposed method MRNDM is higher than that of those fused using six previous fusion methods.

CT and MRI image fusion based on contourlet using a novel rule

Image Fusion of CT and MR with Sparse Representation in NSST Domain

Dual Band Image Fusion Method Based on Region Saliency

Multiscale Image Fusion Methods Based on Improved Region Energy Rules

CT and MRI Image Fusion Algorithm Based on Hybrid ℓ0ℓ1 Layer Decomposing and Two-Dimensional Variation Transform

CT and MRI image fusion algorithm based on hybrid l 0 l 1 layer decomposing and two-dimensional variation transform

CT and MRI Image Fusion Based on Multiscale Decomposition Method and Hybrid Approach.

A New Fusion Algorithm for MRI and Color Images Based on Mutual Information in Wavelet Domain

MRI and PET image fusion using the nonparametric density model and the theory of variable-weight

Image Fusion Algorithm at Pixel Level Based on Edge Detection

Medical Image Fusion by Multi-resolution Analysis of Wavelets Transform

Remote Sensing Image Fusion Method Based on Nonsubsampled Contourlet

Empirical Curvelet-ridgelet Wavelet Transform for Multimodal Fusion of Brain Images

Fusion of mis-registered GFP and phase contrast images with convolutional sparse representation and adaptive region energy rule.

Multiscale Image Fusion Methods Based on Wavelet-Domain

An Image Fusion Method Based on Sparse Representation and Sum Modified-Laplacian in NSCT Domain

Infrared and visible image fusion enhancement technology based on multi-scale directional analysis

Effective Image Fusion Rules Of Multi-Scale Image Decomposition

Multi-Focus Image Fusion via Distance-Weighted Regional Energy and Structure Tensor in NSCT Domain

Confocal microscopy multi-focus image fusion method based on axial information guidance

Fusion of GFP and phase contrast images with complex shearlet transform and Haar wavelet-based energy rule.