A novel framework of multimodal medical image fusion using adaptive NSST and optimized deep learning approach

K. Vanitha,D. Satyanarayana,M. N. GiriPrasad
DOI: https://doi.org/10.1080/13682199.2023.2241793
2023-08-16
The Imaging Science Journal
Abstract:Multimodal medical image fusion plays a pivotal role in the medical and imaging industry. Existing works of deep learning method suffers from blurred texture characteristics and computing efficiency. Thus, a novel deep learning model is proposed for multimodal medical image fusion. Initially, an Adaptive Non-Subsampled Shearlet Transform (ANSST) approach is developed for decomposing the images, where the filter coefficient is optimized by Hybrid Water Strider-Dingo Optimization (HWS-DOX). The fusion of the high sub-bands of source image 1 and high sub-bands of source image 2 is done by an Optimized Deep Neural Network (ODNN). Then, the lower sub-bands of source image 1 and lower sub-bands of source image 2 will be fused through a weighted averaging scheme. Finally, the final fused images are attained by applying the inverse ANSST. Thus, the performance of recommended module is compared over classical heuristics and various transform methods.
imaging science & photographic technology
What problem does this paper attempt to address?