Abstract:ABSTRACT Throughout the past 20 years, medical imaging has found extensive application in clinical diagnosis. Doctors may find it difficult to diagnose diseases using only one imaging modality. The main objective of multimodal medical image fusion (MMIF) is to improve both the accuracy and quality of clinical assessments by extracting structural and spectral information from source images. This study proposes a novel MMIF method to assist doctors and postoperations such as image segmentation, classification, and further surgical procedures. Initially, the intensity‐hue‐saturation (IHS) model is utilized to decompose the positron emission tomography (PET)/single photon emission computed tomography (SPECT) image, followed by a hue‐angle mapping method to discriminate high‐ and low‐activity regions in the PET images. Then, a proposed structure feature adjustment (SFA) mechanism is used as a fusion strategy for high‐ and low‐activity regions to obtain structural and anatomical details with minimum color distortion. In the second step, a new multi‐discriminator generative adversarial network (MDcGAN) approach is proposed for obtaining the final fused image. The qualitative and quantitative results demonstrate that the proposed method is superior to existing MMIF methods in preserving the structural, anatomical, and functional details of the PET/SPECT images. Through our assessment, involving visual analysis and subsequent verification using statistical metrics, it becomes evident that color changes contribute substantial visual information to the fusion of PET and MR images. The quantitative outcomes demonstrate that, in the majority of cases, the proposed algorithm consistently outperformed other methods. Yet, in a few instances, it achieved the second‐highest results. The validity of the proposed method was confirmed using diverse modalities, encompassing a total of 1012 image pairs.

Quality Assessment of Multimodal Medical Image Fusion Images Using Chromaticity Similarity and Information Similarity

Medical image fusion quality assessment based on conditional generative adversarial network

A Brief Analysis of Multimodal Medical Image Fusion Techniques

Multi-modal medical image super-resolution fusion based on detail enhancement and weighted local energy deviation

A New Assessment Method for Image Fusion Quality

Multimodal medical image fusion based on visual saliency map and multichannel dynamic threshold neural P systems in sub-window variance filter domain

Multimodal Medical Image Fusion Based on Joint Bilateral Filter and Local Gradient Energy.

Multimodal Medical Image Fusion Towards Future Research: A Review

A Review of Multimodal Medical Image Fusion Techniques

A review on multimodal medical image fusion: Compendious analysis of medical modalities, multimodal databases, fusion techniques and quality metrics

An Improved Multimodal Medical Image Fusion Approach Using Intuitionistic Fuzzy Set and Intuitionistic Fuzzy Cross-Correlation

A Novel GA-Based Optimized Approach for Regional Multimodal Medical Image Fusion With Superpixel Segmentation

Medical Image Fusion for Multiple Diseases Features Enhancement

SS-SSAN: a Self-Supervised Subspace Attentional Network for Multi-Modal Medical Image Fusion

Multimodal medical image fusion based on interval gradients and convolutional neural networks

Intelligent multimodal medical image fusion with deep guided filtering

Model for Evaluating Quality of Medical Image Fusion

Multimodal Fusion on Low-quality Data: A Comprehensive Survey

Multimodal medical image fusion based on IHS and PCA

Objective Quality Assessment of Image Fusion

Multimodal medical image fusion using gradient domain guided filter random walk and side window filtering in framelet domain