Multimodal medical image fusion using gradient domain guided filter random walk and side window filtering in framelet domain

Weiwei Kong,Qiguang Miao,Ruyi Liu,Yang Lei,Jing Cui,Qiang Xie
DOI: https://doi.org/10.1016/j.ins.2021.11.033
IF: 8.1
2022-03-01
Information Sciences
Abstract:Since multimodal imaging technology is able to provide multiple perspectives on the lesion, it has become increasingly important in clinical diagnosis and treatment planning. In this paper, a novel medical image fusion using gradient domain-guided filter random walk (GDGFRW) and side window filtering (SWF) in the framelet transform (FT) domain is presented. Firstly, FT is performed on the original multimodal source images to obtain the corresponding approximate and residual representations. Secondly, a novel model—GDGFRW, which combines the superiorities of both gradient domain guided filtering and random walks—is constructed to interpret the approximate sub-bands, while the residual sub-bands are fused by SWF. Finally, the fused approximate sub-bands and residual sub-bands undergo inverse FT to generate the final fused image. To verify its effectiveness, the proposed method was tested on different categories of multimodal medical image fusion issues, in more than 40 pairs of source images. The proposed method outperforms the current representative ones in terms of both subjective visual performance and objective assessment.
computer science, information systems
What problem does this paper attempt to address?