Abstract:Magnetic resonance imaging (MRI) is an important non-invasive clinical tool that can produce high-resolution and reproducible images. However, a long scanning time is required for high-quality MR images, which leads to exhaustion and discomfort of patients, inducing more artefacts due to voluntary movements of the patients and involuntary physiological movements. To accelerate the scanning process, methods by k-space undersampling and deep learning based reconstruction have been popularised. This work introduced SwinMR, a novel Swin transformer based method for fast MRI reconstruction. The whole network consisted of an input module (IM), a feature extraction module (FEM) and an output module (OM). The IM and OM were 2D convolutional layers and the FEM was composed of a cascaded of residual Swin transformer blocks (RSTBs) and 2D convolutional layers. The RSTB consisted of a series of Swin transformer layers (STLs). The shifted windows multi-head self-attention (W-MSA/SW-MSA) of STL was performed in shifted windows rather than the multi-head self-attention (MSA) of the original transformer in the whole image space. A novel multi-channel loss was proposed by using the sensitivity maps, which was proved to reserve more textures and details. We performed a series of comparative studies and ablation studies in the Calgary-Campinas public brain MR dataset and conducted a downstream segmentation experiment in the Multi-modal Brain Tumour Segmentation Challenge 2017 dataset. The results demonstrate our SwinMR achieved high-quality reconstruction compared with other benchmark methods, and it shows great robustness with different undersampling masks, under noise interruption and on different datasets. The code is publicly available at <a class="link-external link-https" href="https://github.com/ayanglab/SwinMR" rel="external noopener nofollow">this https URL</a>.

Swin Transformer for COVID-19 Infection Percentage Estimation from CT-Scans

COVID-19 Detection in Chest X-ray Images Using Swin-Transformer and Transformer in Transformer

COVID-19 diagnosis based on swin transformer model with demographic information fusion and enhanced multi-head attention mechanism

Efficient Lung Cancer Image Classification and Segmentation Algorithm Based on Improved Swin Transformer

A Novel-based Swin Transfer Based Diagnosis of COVID-19 Patients

Efficient Lung Cancer Image Classification and Segmentation Algorithm Based on an Improved Swin Transformer

SwinRes: A Hybrid Model That Effectively Diagnoses COVID-19 Through X-Ray Lung Images

Classification of X-ray Images of COVID-19 Based on CNN and Improved Swin Transformer Model

Exploring Transformer for Face Mask Detection

STCNet: Alternating CNN and improved transformer network for COVID-19 CT image segmentation

Swin Transformer for Fast MRI

COVID-19 detection using ViT transformer-based approach from Computed Tomography Images

Detection and Classification of Lung Cancer Cells Using Swin Transformer

Identification of Asymptomatic COVID-19 Patients on Chest CT Images Using Transformer-Based or Convolutional Neural Network–Based Deep Learning Models

Shifted Windows Transformers for Medical Image Quality Assessment

COVID-19 Pneumonia Classification with Transformer from Incomplete Modalities

A novel Swin transformer approach utilizing residual multi-layer perceptron for diagnosing brain tumors in MRI images

Visual Transformer with Statistical Test for COVID-19 Classification

Swin-Tempo: Temporal-Aware Lung Nodule Detection in CT Scans as Video Sequences Using Swin Transformer-Enhanced UNet

Study of Vision Transformers for Covid-19 Detection from Chest X-rays

On the differences between CNNs and vision transformers for COVID-19 diagnosis using CT and chest x-ray mono- and multimodality