CT-To-MR Conditional Generative Adversarial Networks for Ischemic Stroke Lesion Segmentation

Jonathan Rubin,S. Mazdak Abulnaga
DOI: https://doi.org/10.48550/arXiv.1904.13281
2019-04-30
Abstract:Infarcted brain tissue resulting from acute stroke readily shows up as hyperintense regions within diffusion-weighted magnetic resonance imaging (DWI). It has also been proposed that computed tomography perfusion (CTP) could alternatively be used to triage stroke patients, given improvements in speed and availability, as well as reduced cost. However, CTP has a lower signal to noise ratio compared to MR. In this work, we investigate whether a conditional mapping can be learned by a generative adversarial network to map CTP inputs to generated MR DWI that more clearly delineates hyperintense regions due to ischemic stroke. We detail the architectures of the generator and discriminator and describe the training process used to perform image-to-image translation from multi-modal CT perfusion maps to diffusion weighted MR outputs. We evaluate the results both qualitatively by visual comparison of generated MR to ground truth, as well as quantitatively by training fully convolutional neural networks that make use of generated MR data inputs to perform ischemic stroke lesion segmentation. Segmentation networks trained using generated CT-to-MR inputs result in at least some improvement on all metrics used for evaluation, compared with networks that only use CT perfusion input.
Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
What problem does this paper attempt to address?
The problem that this paper attempts to solve is how to use Generative Adversarial Networks (GANs) to generate Diffusion - Weighted Magnetic Resonance Imaging (DWI) images from Computed Tomography Perfusion (CTP) data, in order to improve the segmentation effect of ischemic stroke lesions. Specifically, because CTP has advantages in terms of speed, availability and cost, but its signal - to - noise ratio is low and it cannot clearly show the high - signal areas caused by ischemic stroke as DWI does. Therefore, the researchers proposed a Conditional Generative Adversarial Network (CGAN), by learning the mapping relationship from CTP to DWI, generating clearer high - signal area images, thereby improving the accuracy of ischemic stroke lesion segmentation based on the generated images. The key contributions of the paper include: 1. Developed and trained a modified version of the Conditional Generative Adversarial Network (CGAN) for reconstructing diffusion - weighted MRI images from CTP maps. 2. Combined the generated MRI images with CTP data to train a Fully Convolutional Neural Network (FCN) for the segmentation of ischemic core stroke lesions. 3. Demonstrated that the conditional mapping learned from CTP input can generate clearer high - signal areas, thus achieving better lesion segmentation results on the generated MRI than previous models. Through these methods, the researchers aim to explore whether the high - signal areas in MRI can be simulated from CTP input through CGAN, thereby improving the performance of ischemic stroke lesion segmentation.