Abstract:With the rapid development of medical imaging methods, multimodal medical image fusion techniques have caught the interest of researchers. The aim is to preserve information from diverse sensors using various models to generate a single informative image. The main challenge is to derive a trade-off between the spatial and spectral qualities of the resulting fused image and the computing efficiency. This article proposes a fast and reliable method for medical image fusion depending on multilevel Guided edge-preserving filtering (MLGEPF) decomposition rule. First, each multimodal medical image was divided into three sublayer categories using an MLGEPF decomposition scheme: small-scale component, large-scale component and background component. Secondly, two fusion strategies—pulse-coupled neural network based on the structure tensor and maximum based—are applied to combine the three types of layers, based on the layers' various properties. The three different types of fused sublayers are combined to create the fused image at the end. A total of 40 pairs of brain images from four separate categories of medical conditions were tested in experiments. The pair of images includes various case studies including magnetic resonance imaging (MRI) , TITc, single-photon emission computed tomography (SPECT) and positron emission tomography (PET). We included qualitative analysis to demonstrate that the visual contrast between the structure and the surrounding tissue is increased in our proposed method. To further enhance the visual comparison, we asked a group of observers to compare our method’s outputs with other methods and score them. Overall, our proposed fusion scheme increased the visual contrast and received positive subjective review. Moreover, objective assessment indicators for each category of medical conditions are also included. Our method achieves a high evaluation outcome on feature mutual information (FMI), the sum of correlation of differences (SCD), Qabf and Qy indexes. This implies that our fusion algorithm has better performance in information preservation and efficient structural and visual transferring.

Medical image fusion based on extended difference-of-Gaussians and edge-preserving

Medical image fusion based on improved multi-scale morphology gradient-weighted local energy and visual saliency map

Medical image fusion based on sparse representation and neighbor energy activity

Medical image fusion based on quasi-cross bilateral filtering

A new approach to medical image fusion based on the improved Extended difference-of-Gaussians combined with the Coati optimization algorithm

Medical image fusion using multi-level local extrema

Multimodal medical image fusion using gradient domain guided filter random walk and side window filtering in framelet domain

Advancing multimodal medical image fusion: an adaptive image decomposition approach based on multilevel Guided filtering

Multi-Sensor Medical-Image Fusion Technique Based on Embedding Bilateral Filter in Least Squares and Salient Detection

MRI and PET/SPECT fusion with pseudo spatial frequency in local laplacian filter domain

Adaptive Decomposition Method for Multi-Modal Medical Image Fusion.

Medical Image Fusion for Multiple Diseases Features Enhancement

Multimodal medical image fusion based on visual saliency map and multichannel dynamic threshold neural P systems in sub-window variance filter domain

Medical image fusion using segment graph filter and sparse representation

Multi-modality medical image fusion based on guided filter and image statistics in multidirectional shearlet transform domain

Multi-modal medical image fusion based on equilibrium optimizer algorithm and local energy functions

Medical image fusion via discrete stationary wavelet transform and an enhanced radial basis function neural network

EgeFusion: Towards Edge Gradient Enhancement in Infrared and Visible Image Fusion With Multi-Scale Transform

Multi-Modal Medical Image Fusion Based on FusionNet in YIQ Color Space

Multimodal medical image fusion based on interval gradients and convolutional neural networks

Edge-Enhanced Dilated Residual Attention Network for Multimodal Medical Image Fusion