Multi-scale Deformable Transformer for Multi-Contrast Knee MRI Super-Resolution.

Beiji Zou,Zexin Ji,Chengzhang Zhu,Yulan Dai,Wensheng Zhang,Xiaoyan Kui
DOI: https://doi.org/10.1016/j.bspc.2022.104154
IF: 5.1
2022-01-01
Biomedical Signal Processing and Control
Abstract:Background and objective: Magnetic resonance imaging can present the precise anatomic structure in clinical applications. Nevertheless, due to the limited scanning equipment cost, scanning time and so on, high -resolution knee MR images are difficult to obtain. So the super-resolution technique is developed to improve the image quality. Unfortunately, conventional CNN-based methods cannot explicitly learn the long-range dependencies in images and simply integrate the auxiliary contrast without considering the characteristics of medical images. To tackle this issue, our approach aims to adaptively capture and fuse the significant auxiliary information of the multi-contrast images to improve the knee magnetic resonance image quality.Methods: We propose a multi-scale deformable transformer network (MSDT) for multi-contrast knee magnetic resonance imaging super-resolution. First, we aggregate multi-scale patch embedding from the multi-contrast knee MR images to effectively preserve the local contextual details and global structure information. Then, the deformable transformer architecture is designed to learn the data-dependent sparse attention of the knee MR image, which can adaptively obtain the high-frequency foreground details according to the image content.Results: The proposed method is evaluated on the fastMRI dataset under 2x and 4x enlargements. Our MSDT achieves higher PSNR of 31.98 and SSIM of 0.713 at 2x upsampling factor and PSNR of 30.38 and SSIM of 0.615 at 4x upsampling factor. Moreover, our method can generate clear tissue structures and fine details.Conclusions: The experimental results show superior performance in comparison to the state-of-the-art super -resolution methods. This indicates that the MSDT can effectively reconstruct the high-quality knee MR images.
What problem does this paper attempt to address?