Data and Physics driven Deep Learning Models for Fast MRI Reconstruction: Fundamentals and Methodologies

Jiahao Huang,Yinzhe Wu,Fanwen Wang,Yingying Fang,Yang Nan,Cagan Alkan,Daniel Abraham,Congyu Liao,Lei Xu,Zhifan Gao,Weiwen Wu,Lei Zhu,Zhaolin Chen,Peter Lally,Neal Bangerter,Kawin Setsompop,Yike Guo,Daniel Rueckert,Ge Wang,Guang Yang
2024-10-21
Abstract:Magnetic Resonance Imaging (MRI) is a pivotal clinical diagnostic tool, yet its extended scanning times often compromise patient comfort and image quality, especially in volumetric, temporal and quantitative scans. This review elucidates recent advances in MRI acceleration via data and physics-driven models, leveraging techniques from algorithm unrolling models, enhancement-based methods, and plug-and-play models to the emerging full spectrum of generative model-based methods. We also explore the synergistic integration of data models with physics-based insights, encompassing the advancements in multi-coil hardware accelerations like parallel imaging and simultaneous multi-slice imaging, and the optimization of sampling patterns. We then focus on domain-specific challenges and opportunities, including image redundancy exploitation, image integrity, evaluation metrics, data heterogeneity, and model generalization. This work also discusses potential solutions and future research directions, with an emphasis on the role of data harmonization and federated learning for further improving the general applicability and performance of these methods in MRI reconstruction.
Signal Processing
What problem does this paper attempt to address?
### What problems does this paper attempt to solve? This paper aims to solve the problem of overly long scanning time in magnetic resonance imaging (MRI). Specifically: 1. **The impact of extended scanning time on patient comfort and image quality**: - MRI scans take a long time, which not only makes patients uncomfortable but may also lead to a decline in image quality, especially during volume, time, and quantitative scans. 2. **The need to accelerate MRI scans**: - The paper explores methods to accelerate MRI scans through data - driven and physics - driven models. These methods include algorithm unrolling models, enhanced methods, plug - and - play models, and emerging generative model methods. 3. **Limitations of existing acceleration techniques**: - Existing hardware acceleration techniques such as parallel imaging and in - plane multi - slice imaging are effective, but their acceleration rates are limited. - Traditional methods such as Compressed Sensing (CS) rely on hand - designed sparse priors, which may cause artifacts in reconstructed images at high acceleration rates. 4. **The application of deep learning in MRI acceleration**: - Deep learning methods can learn the distribution characteristics of MR images, avoid manual assumptions, and can reconstruct images more accurately and reduce artifacts. These methods cover algorithm unrolling models, enhanced methods, plug - and - play models, and generative models (such as VAE, GAN, EBM, diffusion models, and normalization flow models). 5. **Co - integrating data models and physical models**: - The paper also explores how to co - integrate data models and physics - based insights to optimize sampling patterns and improve the effectiveness of multi - coil hardware acceleration, such as parallel imaging and simultaneous multi - slice imaging. 6. **Domain - specific challenges and opportunities**: - The article discusses domain - specific challenges and opportunities, including issues such as data redundancy utilization, image integrity, selection of evaluation metrics, data heterogeneity, and model generalization. Through these methods and techniques, the paper hopes to further increase the speed and image quality of MRI scans, thereby improving the patient experience and enhancing the effectiveness of clinical applications. ### Summary The core problem of this paper is to accelerate the MRI scanning process, improve image quality and patient comfort by combining data - driven and physics - driven deep learning models, while also solving the limitations of existing acceleration techniques.