Abstract:Purpose Arterial spin labeling (ASL) magnetic resonance imaging (MRI) is an advanced noninvasive imaging technology that can measure cerebral blood flow (CBF) quantitatively without a contrast agent injection or radiation exposure. However, because of the weak labeling, conventional ASL images usually suffer from low signal-to-noise ratio (SNR), poor spatial resolution, and long acquisition time. Therefore, a method that can simultaneously improve the spatial resolution and SNR is needed. Methods In this work, we proposed an unsupervised superresolution (SR) method to improve ASL image resolution based on a pyramid of generative adversarial networks (GAN). Through layer-by-layer training, the generators can learn features from the coarsest to the finest. The last layer's generator that contains fine details and textures was used to generate the final SR ASL images. In our proposed framework, the corresponding T1-weighted MR image was supplied as a second-channel input of the generators to provide high-resolution prior information. In addition, a low-pass-filter loss term was included to suppress the noise of the original ASL images. To evaluate the performance of the proposed framework, a simulation study and two real-patient experiments based on the in vivo datasets obtained from three healthy subjects on a 3T MR scanner were conducted, regarding the low-resolution (LR) to normal-resolution (NR) and the NR-to-SR tasks. The proposed method was compared to the nearest neighbor interpolation, trilinear interpolation, third-order B-splines interpolation methods, and deep image prior (DIP) with the peak signal-to-noise ratio (PSNR) and structural similarity index (SSIM) as the quantification metrics. The averaged ASL images acquired with 44 min acquisition time were used as the ground truth for real-patient LR-to-NR study. The ablation studies of low-pass-filter loss term and T1-weighted MR image were performed based on simulation data. Results For the simulation study, results show that the proposed method achieved significantly higher PSNR (p$p$-value <$ 0.05) and SSIM (p$p$-value <$ 0.05) than the nearest neighbor interpolation, trilinear interpolation, third-order B-splines interpolation, and DIP methods. For the real-patient LR-to-NR experiment, results show that the proposed method can generate high-quality SR ASL images with clearer structure boundaries and low noise levels and has the highest mean PSNR and SSIM. For real-patient NR-to-SR tasks, the structure of the results using the proposed method is sharper and clearer, which are the most similar to the structure of the reference 44 min acquisition image than other methods. The proposed method also shows the ability to remove artifacts in the NR image while superresolution. The ablation study verified that the low-pass-filter loss term and T1-weighted MR image are necessary for the proposed method. Conclusions The proposed unsupervised multiscale GAN framework can simultaneously improve spatial resolution and reduce image noise. Experiment results from simulation data and three healthy subjects show that the proposed method achieves better performance than the nearest neighbor interpolation, the trilinear interpolation, the third-order B-splines interpolation, and DIP methods.

Image Super Resolution for Scanning Tunneling Microscopy and Atomic Force Microscopy

Single Remote Sensing Image Super-Resolution Via a Generative Adversarial Network with Stratified Dense Sampling and Chain Training

Large-scale microscope with improved resolution using SRGAN

General Resolution Enhancement Method in Atomic Force Microscopy (AFM) Using Deep Learning

Boosting Resolution and Recovering Texture of micro-CT Images with Deep Learning

Unsupervised arterial spin labeling image superresolution via multiscale generative adversarial network

Super-resolving microscopy images of Li-ion electrodes for fine-feature quantification using generative adversarial networks

Super-Resolution Based On Generative Adversarial Network For Hrtem Images

Resolution enhancement in scanning electron microscopy using deep learning

Resolution Enhancement of Scanning Electron Micrographs using Artificial Intelligence

Rapid and Extreme Low-light Superresolution Imaging Via Artificial Intelligence

Deep-learning-augmented Microscopy for Super-Resolution Imaging of Nanoparticles.

Autonomous Scanning Tunneling Microscopy Imaging via Deep Learning

Multiple-image super-resolution of cryo-electron micrographs based on deep internal learning

Deep Learning Super-Resolution Electron Microscopy Based on Deep Residual Attention Network

Deep Learning-Enabled Resolution-Enhancement in Mini- and Regular Microscopy for Biomedical Imaging

Super-resolution technology to simultaneously improve optical & digital resolution of optical coherence tomography via deep learning.

SMC-SRGAN-Lightning super-resolution algorithm based on optical micro-scanning thermal microscope image

X-Microscopy: Multicolor Super Resolution Image Reconstruction from Conventional Microscopy with Deep Learning

A novel hybrid generative adversarial network for CT and MRI super-resolution reconstruction

Super‐Resolution Near‐Infrared Fluorescence Microscopy of Single‐Walled Carbon Nanotubes Using Deep Learning