Abstract:Magnetic Resonance Imaging (MRI) plays a pivotal role in modern clinical practice, providing detailed anatomical visualization with exceptional spatial resolution and soft tissue contrast. Dynamic MRI, aiming to capture both spatial and temporal characteristics, faces challenges related to prolonged acquisition times and susceptibility to motion artifacts. Balancing spatial and temporal resolutions becomes crucial in real-world clinical scenarios. In the realm of dynamic MRI reconstruction, while Convolutional Recurrent Neural Networks (CRNNs) struggle with long-range dependencies, CRNNs require extensive iterations, impacting efficiency. Transformers, known for their effectiveness in high-dimensional imaging, are underexplored in dynamic MRI reconstruction. Additionally, prevailing algorithms fall short of achieving superior results in demanding generative reconstructions at high acceleration rates. This research proposes a novel approach for dynamic MRI reconstruction, named CRNN-Refined Spatiotemporal Transformer Network (CST-Net). The spatiotemporal Transformer initiates reconstruction, modeling temporal and spatial correlations, followed by refinement using the CRNN. This integration mitigates inaccuracies caused by damaged frames and reduces CRNN iterations, enhancing computational efficiency without compromising reconstruction quality. Our study compares the performance of the proposed CST-Net at 6 × and 12 × undersampling rates, showcasing its superiority over existing algorithms. Particularly, in challenging 25× generative reconstructions, the CST-Net outperforms current methods. The comparison includes experiments under both radial and Cartesian undersampling patterns. In conclusion, CST-Net successfully addresses the limitations inherent in existing generative reconstruction algorithms, thereby paving the way for further exploration and optimization of Transformer-based approaches in dynamic MRI reconstruction. Code and Datasets can be available: https://github.com/XWangBin/CST-Net.

Learning Dynamic MRI Reconstruction with Convolutional Network Assisted Reconstruction Swin Transformer

Deep Learning for Under-Sampled Non-Cartesian ASL MRI Reconstruction

Single-view Cone Beam CT Reconstruction with Swin Transformer Based Deep Learning.

Swin Transformer for Fast MRI

Deep Learning Based MRI Reconstruction with Transformer

Fast MRI Reconstruction: How Powerful Transformers Are?

Multi-branch Cascaded Swin Transformers with Attention to k-space Sampling Pattern for Accelerated MRI Reconstruction

SwinGAN: A dual-domain Swin Transformer-based generative adversarial network for MRI reconstruction

CRNN-Refined Spatiotemporal Transformer for Dynamic MRI reconstruction

MDST: multi-domain sparse-view CT reconstruction based on convolution and swin transformer

Accelerating Dynamic MRI Reconstruction Using Adaptive Sequentially Truncated Higher-Order Singular Value Decomposition

Swin Deformable Attention U-Net Transformer (SDAUT) for Explainable Fast MRI

Accelerating cardiac diffusion tensor imaging using Swin transformer with octave convolution

SDLFormer: A Sparse and Dense Locality-enhanced Transformer for Accelerated MR Image Reconstruction

Data-Consistent Non-Cartesian Deep Subspace Learning for Efficient Dynamic MR Image Reconstruction

ReconFormer: Accelerated MRI Reconstruction Using Recurrent Transformer

Static MRI Reconstruction Based on K-space and Image-domain Information

Real Time Dynamic Magnetic Resonance Imaging Via Dictionary Learning and Combined Fourier Transform.

Iterative Temporal-Spatial Transformer-based Cardiac T1 Mapping MRI Reconstruction

SwinUNETR-V2: Stronger Swin Transformers with Stagewise Convolutions for 3D Medical Image Segmentation

Reconstruction Of Undersampled Big Dynamic Mri Data Using Non-Convex Low-Rank And Sparsity Constraints