Multi-Modal Multi-Slice Cooperative Dual-Domain Cascaded De-Aliasing Network for MR Imaging Reconstruction

Xuebin Sun,Yanwei Pang,Yiming Liu,Caifeng Shan,Shing Shin Cheng
DOI: https://doi.org/10.1109/jbhi.2024.3413083
IF: 7.7
2024-01-01
IEEE Journal of Biomedical and Health Informatics
Abstract:Recent advancements in Magnetic Resonance Imaging (MRI) reconstruction techniques aim to accelerate the imaging process. However, these methods still face two key limitations. Firstly, although the same location consistently provides anatomical information across different modalities, such as organs, tissues, or lesions, previous studies have predominantly relied on single-modality information, overlooking the potential advantages of incorporating complementary data from other modalities. Secondly, while adjacent MRI slices often capture the same location or organ with similar anatomical structures, only a few methods consider the information from neighboring slices during the reconstruction process. To address these challenges, we propose a M ulti-modal M ulti-slice cooperative D ual-domain cascaded de-alising network for MR imaging R econstruction (MMDR). Specifically, we design a multi-slice and multi-modal feature fusion network based on 3D convolution and swin transformer that efficiently extracts multi-modal features from MRI. Then, a dual domain cascaded recurrent network through dense-blocks with large receptive fields for fast MRI reconstruction is explored. Extensive experiments on the IXI datasets were carried out to evaluate the proposed method's robustness across varying network structures, under-sampling rates, and sampling patterns. MMDR demonstrates promising performance across both qualitative and quantitative metrics, particularly with a competitive PSNE of 42.15 and an SSIM of 0.984 for T2 reconstruction using 30% T2WI and PDWI, as well as achieving a PSNE of 39.92 and an SSIM of 0.966 for PDWI reconstruction with 30% PDWI and T2WI.
What problem does this paper attempt to address?