Flexible Alignment Super-Resolution Network for Multi-Contrast Magnetic Resonance Imaging

Yiming Liu,Mengxi Zhang,Bo Jiang,Bo Hou,Dan Liu,Jie Chen,Heqing Lian
DOI: https://doi.org/10.1109/tmm.2023.3330085
IF: 7.3
2024-01-01
IEEE Transactions on Multimedia
Abstract:Super-resolution is essential in improving the image quality of Magnetic Resonance Imaging (MRI). Existing MRI Super-Resolution methods leverage multi-contrast MRI and achieve satisfied effects. However, these methods perform alignment by calculating the similarity of single-scale semantic features between reference images and low-resolution images, which causes misalignment and limits the performance of MRI Super-Resolution. To tackle this problem, we propose the Flexible Alignment Super-resolution Network (FASR-Net) for multi-contrast MRI Super-resolution, which explores the interaction of multi-scale features. To this end, we first use the feature extractor to generate multi-scale features, including hierarchical features and semantic pyramid features. Subsequently, we introduce the Hierarchical-Feature Alignment (HF) module and the Semantic-Pyramid-Feature Alignment (SF) module to align hierarchical features and semantic pyramid features, respectively. Finally, the Cross-Hierarchical Progressive Fusion (CHPF) module fuses these aligned features at different scales, which further improves the model's performance. Extensive experiments on FastMRI and IXI datasets show that FASR-net achieves the most competitive results over state-of-the-art approaches. Our code will be available at FASR-Net .
What problem does this paper attempt to address?