Abstract:Summary Medical image fusion has advanced to the point that it is now possible to combine multiple medical images for accurate disease diagnosis and treatment. The state‐of‐art techniques based on spatial and transform domains suffer from different limitations such as low fused image quality, spectral degradation, contrast reduction, low edge information preserving, lack of shift‐invariance, high computational complexity, classification accuracy, and sensitivity to noise. The main motivation of this work is to generate a single image with excellent visual clarity that retains the features of the source images. This article proposes a water wave optimized nonsubsampled shearlet transformation technique (NSST) for multimodal medical image fusion, in which the water wave optimization (WWO) algorithm is used to allocate the weights of the NSST approach's high‐frequency subbands. The NSST approach is primarily used in this work due to its ability to withstand shift‐invariance and its potential to improve the visual clarity of the fused multimodal image by preserving the essential features present in the image's various directions and edges. We combined the NSST technique with the WWO algorithm, which processes the edges, details, and contourlets of medical images using a max selection strategy based on the fitness function, to improve image quality and computational costs. The WWO algorithm is mainly applied to the NSST to minimize the L1 distance between the fused and the source images. Hence to overcome this problem a condition CNN optimized with a hybrid tunicate swarm memetic (TSM) algorithm is used to incorporate both the benefits offered by the condition CNN–TSM algorithm and NSST. The TSM optimized condition CNN architecture is used to preserve the coefficients of the image and improve the perceiving capability of the high‐frequency sub‐bands. An inverse NSST is used for fused frequency sub‐band integration. Finally, the efficiency of the proposed methodology is evaluated in terms of enhanced visual feature quality, edge detection, contour detection, and computational performance.

CT and MRI multi-modal medical image fusion using weight-optimized anisotropic diffusion filtering

MRI and PET/SPECT Image Fusion Based on Adaptive Weighted Guided Image Filtering

MRI and CT Medical Image Fusion Based on Synchronized-Anisotropic Diffusion Model.

Medical Images Fusion by Using Weighted Least Squares Filter and Sparse Representation

Fusion of MRI and CT Images Using Guided Image Filter and Image Statistics.

CT and MRI image fusion based on weight difference between L1 and L2 norm

Medical Image Fusion by Multi-resolution Analysis of Wavelets Transform

A novel approach for multimodal medical image fusion

Multi-Modal Medical Image Fusion Based on Gradient Domain Guided Image Filter

Adaptive Weighted PET/SPECT and MR Medical Image Fusion Based on Nonsubsampled Shearlet Transform

CT and MRI Image Fusion Based on Multiscale Decomposition Method and Hybrid Approach.

Multi-modality medical image fusion based on guided filter and image statistics in multidirectional shearlet transform domain

Multi-modal Medical Neurological Image Fusion using Wavelet Pooled Edge Preserving Autoencoder

Water wave optimized nonsubsampled shearlet transformation technique for multimodal medical image fusion

Medical Image Fusion Based on Wavelet Transform and Independent Component Analysis.

NSCT-DCT based Fourier Analysis for Fusion of Multimodal Images

Intelligent multimodal medical image fusion with deep guided filtering

MR and CT Image Fusion Using Nonlinear Anisotropic Filtering in PCA Domain

Medical image fusion based on improved multi-scale morphology gradient-weighted local energy and visual saliency map

Optifusion: advancing visual intelligence in medical imaging through optimized CNN-TQWT fusion

Fusion of Multimodal Medical Images based on Fine-grained Saliency and Anisotropic Diffusion Filter