Abstract:Magnetic resonance imaging (MRI) is one of the most important modalities for clinical diagnosis. However, the main disadvantages of MRI are the long scanning time and the moving artifact caused by patient movement during prolonged imaging. It can also lead to patient anxiety and discomfort, so accelerated imaging is indispensable for MRI. Convolutional neural network (CNN) based methods have become the fact standard for medical image reconstruction, and generative adversarial network (GAN) have also been widely used. Nevertheless, due to the limited ability of CNN to capture long-distance information, it may lead to defects in the structure of the reconstructed images such as blurry contour. In this paper, we propose a novel Swin Transformer-based dual-domain generative adversarial network (SwinGAN) for accelerated MRI reconstruction. The SwinGAN consists of two generators: a frequency-domain generator and an image-domain generator. Both the generators utilize Swin Transformer as backbone for effectively capturing the long-distance dependencies. A contextual image relative position encoder (ciRPE) is designed to enhance the ability to capture local information. We extensively evaluate the method on the IXI brain dataset, MICCAI 2013 dataset and MRNet knee dataset. Compared with KIGAN, the peak signal-to-noise ratio (PSNR) and structural similarity index measure (SSIM) are improved by 6.1% and 1.49% to 37.64 dB and 0.98 on IXI dataset respectively, which demonstrates that our model can sufficiently utilize the local and global information of image. The model shows promising performance and robustness under different undersampling masks, different acceleration rates and different datasets. But it needs high hardware requirements with the increasing of the network parameters. The code is available at: https://github.com/learnerzx/SwinGAN.

Swin-GAN: Generative Adversarial Network Based on Shifted Windows Transformer Architecture for Image Generation

TcGAN: Semantic-Aware and Structure-Preserved GANs with Individual Vision Transformer for Fast Arbitrary One-Shot Image Generation

SpatialGAN: Progressive Image Generation Based on Spatial Recursive Adversarial Expansion

A GAN-based Tunable Image Compression System

SwinGAN: A dual-domain Swin Transformer-based generative adversarial network for MRI reconstruction

SWCGAN: Generative Adversarial Network Combining Swin Transformer and CNN for Remote Sensing Image Super-Resolution

CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windows

UGC: Unified GAN Compression for Efficient Image-to-Image Translation

Swin Transformer: Hierarchical Vision Transformer using Shifted Windows

Swin transformer-based GAN for multi-modal medical image translation

GIU-GANs: Global Information Utilization for Generative Adversarial Networks

Degenerate Swin to Win: Plain Window-based Transformer without Sophisticated Operations

CT-GAN: A conditional Generative Adversarial Network of transformer architecture for text-to-image

SwinFG: A fine-grained recognition scheme based on swin transformer

A Novel Generator With Auxiliary Branch for Improving GAN Performance

Swin transformer and ResNet based deep networks for low-light image enhancement

EGAIN: Extended GAn INversion

Transformation GAN for Unsupervised Image Synthesis and Representation Learning