Abstract:Magnetic resonance imaging (MRI) is one of the most important modalities for clinical diagnosis. However, the main disadvantages of MRI are the long scanning time and the moving artifact caused by patient movement during prolonged imaging. It can also lead to patient anxiety and discomfort, so accelerated imaging is indispensable for MRI. Convolutional neural network (CNN) based methods have become the fact standard for medical image reconstruction, and generative adversarial network (GAN) have also been widely used. Nevertheless, due to the limited ability of CNN to capture long-distance information, it may lead to defects in the structure of the reconstructed images such as blurry contour. In this paper, we propose a novel Swin Transformer-based dual-domain generative adversarial network (SwinGAN) for accelerated MRI reconstruction. The SwinGAN consists of two generators: a frequency-domain generator and an image-domain generator. Both the generators utilize Swin Transformer as backbone for effectively capturing the long-distance dependencies. A contextual image relative position encoder (ciRPE) is designed to enhance the ability to capture local information. We extensively evaluate the method on the IXI brain dataset, MICCAI 2013 dataset and MRNet knee dataset. Compared with KIGAN, the peak signal-to-noise ratio (PSNR) and structural similarity index measure (SSIM) are improved by 6.1% and 1.49% to 37.64 dB and 0.98 on IXI dataset respectively, which demonstrates that our model can sufficiently utilize the local and global information of image. The model shows promising performance and robustness under different undersampling masks, different acceleration rates and different datasets. But it needs high hardware requirements with the increasing of the network parameters. The code is available at: https://github.com/learnerzx/SwinGAN.

Swin-UNIT: Transformer-based GAN for High-resolution Unpaired Image Translation

Swin transformer-based GAN for multi-modal medical image translation

Unsupervised Image-to-Image Translation with Generative Adversarial Networks.

StyleSwin: Transformer-based GAN for High-resolution Image Generation

Swin-GAN: Generative Adversarial Network Based on Shifted Windows Transformer Architecture for Image Generation

SWCGAN: Generative Adversarial Network Combining Swin Transformer and CNN for Remote Sensing Image Super-Resolution

SwinGAN: A dual-domain Swin Transformer-based generative adversarial network for MRI reconstruction

UVCGAN: UNet Vision Transformer cycle-consistent GAN for unpaired image-to-image translation

SwinNet: Swin Transformer drives edge-aware RGB-D and RGB-T salient object detection

Swin Transformer Embedding UNet for Remote Sensing Image Semantic Segmentation.

Non-local Sparse Attention Based Swin Transformer V2 for Image Super-Resolution

Swin transformer and ResNet based deep networks for low-light image enhancement

Swin Transformer: Hierarchical Vision Transformer using Shifted Windows

ST-GAN: A Swin Transformer-Based Generative Adversarial Network for Unsupervised Domain Adaptation of Cross-Modality Cardiac Segmentation.

Image Super-resolution Reconstruction Network based on Enhanced Swin Transformer via Alternating Aggregation of Local-Global Features

Class-Guided Swin Transformer for Semantic Segmentation of Remote Sensing Imagery

Unsupervised Image Translation Using Multi-Scale Residual GAN

Unsupervised Transformation Network Based on GANs for Target-Domain Oriented Image Translation.

Swin Transformer with Local Aggregation

SwinIT: Hierarchical Image-to-Image Translation Framework Without Cycle Consistency