A Novel MRI and PET Image Fusion in the NSST Domain Using YUV Color Space Based on Convolutional Neural Networks

Jinu Sebastian,G. R. Gnana King
DOI: https://doi.org/10.1007/s11277-023-10542-w
IF: 2.017
2023-06-18
Wireless Personal Communications
Abstract:Medical image fusion techniques combine medical images from various modalities to enhance the accuracy and reliability of medical diagnoses, and they are becoming increasingly significant in a variety of clinical applications. A novel CNN-based MRI and PET image fusion in the NSST domain is proposed in this research. The PET image is first converted to YUV color space. Then, the MRI and the Y component of the PET are fed to CNN to produce a weight map. The obtained weight map and the MRI and Y component of PET are decomposed using NSST. The decomposed bands are then merged based on local similarity-based fusion criteria. By applying inverse NSST, the fused image is produced. The original U and V components are combined with the fused image to get the result. The objective analysis and visual quality assessment proved that the results obtained are superior to those obtained by conventional fusion algorithms.
telecommunications
What problem does this paper attempt to address?