Multi-Modal Medical Image Fusion Via Three-Scale Decomposition and Structure Similarity Balanced Optimization

Hang Zhao,Xiaoli Zhang,Zitong Wang,Feiyang Yang,Rui Zhu
DOI: https://doi.org/10.1016/j.bspc.2024.106358
IF: 5.1
2024-01-01
Biomedical Signal Processing and Control
Abstract:The fine texture, noise and structure information in a source medical image are treated equally, which may cause effective information to be masked or lost, making the fusion result unsatisfactory. To solve this problem, this paper proposes a novel image fusion method guided by internal structural information. First, an adaptive direction smoothing filter is proposed to decompose the input image into a fine-texture layer, a coarse-structure layer and an energy layer to weaken the texture interference in structure extraction. Second, guided by the pre-fused structure image obtained by the neighbor spatial frequency method, a structure similarity balance optimization (SSBO) method for fusing detail layers is proposed. SSBO achieves complete preservation of the fine texture of the image under the influence of interference details. Third, a multi-feature saliency map is calculated based on the direction and intensity information of the energy layer, and adaptive fusion of the energy layer is achieved by selectively emphasizing effective information. Last, the fusion results are obtained through image reconstruction. The experimental results show that compared with several state-of-the-art medical image fusion methods, the proposed fusion method shows superior performance in both subjective perception and quantitative evaluation, and can better retain the details and structure information of the source medical images.
What problem does this paper attempt to address?