Abstract:Diffusion MRI is a non-invasive, in-vivo biomedical imaging method for mapping tissue microstructure. Applications include structural connectivity imaging of the human brain and detecting microstructural neural changes. However, acquiring high signal-to-noise ratio dMRI datasets with high angular and spatial resolution requires prohibitively long scan times, limiting usage in many important clinical settings, especially for children, the elderly, and in acute neurological disorders that may require conscious sedation or general anesthesia. We employ a Swin UNEt Transformers model, trained on augmented Human Connectome Project data and conditioned on registered T1 scans, to perform generalized denoising of dMRI. We also qualitatively demonstrate super-resolution with artificially downsampled HCP data in normal adult volunteers. Remarkably, Swin UNETR can be fine-tuned for an out-of-domain dataset with a single example scan, as we demonstrate on dMRI of children with neurodevelopmental disorders and of adults with acute evolving traumatic brain injury, each cohort scanned on different models of scanners with different imaging protocols at different sites. We exceed current state-of-the-art denoising methods in accuracy and test-retest reliability of rapid diffusion tensor imaging requiring only 90 seconds of scan time. Applied to tissue microstructural modeling of dMRI, Swin UNETR denoising achieves dramatic improvements over the state-of-the-art for test-retest reliability of intracellular volume fraction and free water fraction measurements and can remove heavy-tail noise, improving biophysical modeling fidelity. Swin UNeTR enables rapid diffusion MRI with unprecedented accuracy and reliability, especially for probing biological tissues for scientific and clinical applications. The code and model are publicly available at <a class="link-external link-https" href="https://github.com/ucsfncl/dmri-swin" rel="external noopener nofollow">this https URL</a>.

Swin Transformer for Fast MRI

Fast MRI Reconstruction: How Powerful Transformers Are?

Single-view Cone Beam CT Reconstruction with Swin Transformer Based Deep Learning.

SwinGAN: A dual-domain Swin Transformer-based generative adversarial network for MRI reconstruction

Learning Dynamic MRI Reconstruction with Convolutional Network Assisted Reconstruction Swin Transformer

Deep Learning Based MRI Reconstruction with Transformer

Multi-branch Cascaded Swin Transformers with Attention to k-space Sampling Pattern for Accelerated MRI Reconstruction

SwinUNETR-V2: Stronger Swin Transformers with Stagewise Convolutions for 3D Medical Image Segmentation

A novel Swin transformer approach utilizing residual multi-layer perceptron for diagnosing brain tumors in MRI images

SwinHR: Hemodynamic-powered hierarchical vision transformer for breast tumor segmentation

Swin Deformable Attention U-Net Transformer (SDAUT) for Explainable Fast MRI

Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Images

SwiFT: Swin 4D fMRI Transformer

SSTrans-Net: Smart Swin Transformer Network for medical image segmentation

SwinMM: Masked Multi-view with Swin Transformers for 3D Medical Image Segmentation

SwinBTS: A Method for 3D Multimodal Brain Tumor Segmentation Using Swin Transformer

Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysis

Generative AI for Rapid Diffusion MRI with Improved Image Quality, Reliability and Generalizability

Swin Transformer: Hierarchical Vision Transformer using Shifted Windows