Abstract:PURPOSE:The common practice in acquiring the magnetic resonance (MR) images is to obtain two-dimensional (2D) slices at coarse locations while keeping the high in-plane resolution in order to ensure enough body coverage while shortening the MR scan time. The aim of this study is to propose a novel method to generate HR MR images from low-resolution MR images along the longitudinal direction. In order to address the difficulty of collecting paired low- and high-resolution MR images in clinical settings and to gain the advantage of parallel cycle consistent generative adversarial networks (CycleGANs) in synthesizing realistic medical images, we developed a parallel CycleGANs based method using a self-supervised strategy.METHODS AND MATERIALS:The proposed workflow consists of two parallely trained CycleGANs to independently predict the HR MR images in the two planes along the directions that are orthogonal to the longitudinal MR scan direction. Then, the final synthetic HR MR images are generated by fusing the two predicted images. MR images, including T1-weighted (T1), contrast enhanced T1-weighted (T1CE), T2-weighted (T2), and T2 Fluid Attenuated Inversion Recovery (FLAIR), of the multimodal brain tumor segmentation challenge 2020 (BraTS2020) dataset were processed to evaluate the proposed workflow along the cranial-caudal (CC), lateral, and anterior-posterior directions. Institutional collected MR images were also processed for evaluation of the proposed method. The performance of the proposed method was investigated via both qualitative and quantitative evaluations. Metrics of normalized mean absolute error (NMAE), peak signal-to-noise ratio (PSNR), edge keeping index (EKI), structural similarity index measurement (SSIM), information fidelity criterion (IFC), and visual information fidelity in pixel domain (VIFP) were calculated.RESULTS:It is shown that the proposed method can generate HR MR images visually indistinguishable from the ground truth in the investigations on the BraTS2020 dataset. In addition, the intensity profiles, difference images and SSIM maps can also confirm the feasibility of the proposed method for synthesizing HR MR images. Quantitative evaluations on the BraTS2020 dataset shows that the calculated metrics of synthetic HR MR images can all be enhanced for the T1, T1CE, T2, and FLAIR images. The enhancements in the numerical metrics over the low-resolution and bi-cubic interpolated MR images, as well as those genearted with a comparative deep learning method, are statistically significant. Qualitative evaluation of the synthetic HR MR images of the clinical collected dataset could also confirm the feasibility of the proposed method.CONCLUSIONS:The proposed method is feasible to synthesize HR MR images using self-supervised parallel CycleGANs, which can be expected to shorten MR acquisition time in clinical practices.

Cross-Parametric Generative Adversarial Network-Based Magnetic Resonance Image Feature Synthesis for Breast Lesion Classification

Generative adversarial network-based synthesis of contrast-enhanced MR images from precontrast images for predicting histological characteristics in breast cancer

Simulating Dynamic Tumor Contrast Enhancement in Breast MRI using Conditional Generative Adversarial Networks

Pre- to Post-Contrast Breast MRI Synthesis for Enhanced Tumour Segmentation

Multi-planar dual adversarial network based on dynamic 3D features for MRI-CT head and neck image synthesis

Resolution-dependent MRI-to-CT translation for orthotopic breast cancer models using deep learning

Cross-modality Synthesis Aiding Lung Tumor Segmentation on Multi-Modal MRI Images

Synthesizing lesions using contextual GANs improves breast cancer classification on mammograms

Cross-Modality Augmentation Of Brain Mr Images Using A Novel Pairwise Generative Adversarial Network For Enhanced Glioma Classification

D2FE-GAN: Decoupled dual feature extraction based GAN for MRI image synthesis

A weakly supervised model for incomplete multimodal MRI synthesis with tumor‐aware approach

Conditional generative adversarial network driven radiomic prediction of mutation status based on magnetic resonance imaging of breast cancer

Dynamic Contrast Enhanced MRI Mapping of Vascular Permeability for Evaluation of Breast Cancer Neoadjuvant Chemotherapy Response Using Image-to-Image Conditional Generative Adversarial Networks

Lesion Mask-based Simultaneous Synthesis of Anatomic and MolecularMR Images using a GAN

Multi-Modality Generative Adversarial Networks with Tumor Consistency Loss for Brain MR Image Synthesis

A Time-Intensity Aware Pipeline for Generating Late-Stage Breast DCE-MRI using Generative Adversarial Models

Improvement of Multiparametric MR Image Segmentation by Augmenting the Data With Generative Adversarial Networks for Glioma Patients

Attention-Guided Generative Adversarial Network to Address Atypical Anatomy in Modality Transfer

Bidirectional feature matching based on deep pairwise contrastive learning for multiparametric MRI image synthesis

Synthesizing High-Resolution Magnetic Resonance Imaging Using Parallel Cycle-Consistent Generative Adversarial Networks for Fast Magnetic Resonance Imaging.

Segmentation Guided Crossing Dual Decoding Generative Adversarial Network for Synthesizing Contrast-Enhanced Computed Tomography Images