Abstract:Magnetic Resonance Imaging (MRI) plays a pivotal role in modern clinical practice, providing detailed anatomical visualization with exceptional spatial resolution and soft tissue contrast. Dynamic MRI, aiming to capture both spatial and temporal characteristics, faces challenges related to prolonged acquisition times and susceptibility to motion artifacts. Balancing spatial and temporal resolutions becomes crucial in real-world clinical scenarios. In the realm of dynamic MRI reconstruction, while Convolutional Recurrent Neural Networks (CRNNs) struggle with long-range dependencies, CRNNs require extensive iterations, impacting efficiency. Transformers, known for their effectiveness in high-dimensional imaging, are underexplored in dynamic MRI reconstruction. Additionally, prevailing algorithms fall short of achieving superior results in demanding generative reconstructions at high acceleration rates. This research proposes a novel approach for dynamic MRI reconstruction, named CRNN-Refined Spatiotemporal Transformer Network (CST-Net). The spatiotemporal Transformer initiates reconstruction, modeling temporal and spatial correlations, followed by refinement using the CRNN. This integration mitigates inaccuracies caused by damaged frames and reduces CRNN iterations, enhancing computational efficiency without compromising reconstruction quality. Our study compares the performance of the proposed CST-Net at 6 × and 12 × undersampling rates, showcasing its superiority over existing algorithms. Particularly, in challenging 25× generative reconstructions, the CST-Net outperforms current methods. The comparison includes experiments under both radial and Cartesian undersampling patterns. In conclusion, CST-Net successfully addresses the limitations inherent in existing generative reconstruction algorithms, thereby paving the way for further exploration and optimization of Transformer-based approaches in dynamic MRI reconstruction. Code and Datasets can be available: https://github.com/XWangBin/CST-Net.

PTNet: A High-Resolution Infant MRI Synthesizer Based on Transformer

A Novel Method Of Synthetic Ct Generation From Mr Images Based On Convolutional Neural Networks

TW-Net: Transformer Weighted Network for Neonatal Brain MRI Segmentation

CRNN-Refined Spatiotemporal Transformer for Dynamic MRI reconstruction

Magnetic Resonance Image Processing Transformer for General Reconstruction

HUMUS-Net: Hybrid unrolled multi-scale network architecture for accelerated MRI reconstruction

7T MRI Synthesization from 3T Acquisitions

TRANS-Net: Transformer-Enhanced Residual-Error AlterNative Suppression Network for MRI Reconstruction.

UltimateSynth: MRI Physics for Pan-Contrast AI

High-resolution 3T to 7T MRI Synthesis with a Hybrid CNN-Transformer Model

Synthetic CT Generation from MRI Using 3D Improved Diffusion Model

Deep Generative Adversarial Networks for Thin-Section Infant MR Image Reconstruction

IMPORTANT-Net: Integrated MRI Multi-Parametric Increment Fusion Generator with Attention Network for Synthesizing Absent Data

Synthetic CT Generation from MRI using 3D Transformer-based Denoising Diffusion Model

CT synthesis from MRI with an improved multi-scale learning network

Learning to Synthesize 7 T MRI from 3 T MRI with Few Data by Deformable Augmentation.

A Deep Learning Model for Multi-Domain MRI Synthesis Using Generative Adversarial Networks

Transformer based multi-modal MRI fusion for prediction of post-menstrual age and neonatal brain development analysis

Deep Learning Based MRI Reconstruction with Transformer

ReconFormer: Accelerated MRI Reconstruction Using Recurrent Transformer

Fast MRI Reconstruction: How Powerful Transformers Are?