Predicting Hypoxia in Brain Tumors from Multiparametric MRI

Daniele Perlo,Georgia Kanli,Selma Boudissa,Olivier Keunen
2024-01-25
Abstract:This research paper presents a novel approach to the prediction of hypoxia in brain tumors, using multi-parametric Magnetic Resonance Imaging (MRI). Hypoxia, a condition characterized by low oxygen levels, is a common feature of malignant brain tumors associated with poor prognosis. Fluoromisonidazole Positron Emission Tomography (FMISO PET) is a well-established method for detecting hypoxia in vivo, but it is expensive and not widely available. Our study proposes the use of MRI, a more accessible and cost-effective imaging modality, to predict FMISO PET signals. We investigate deep learning models (DL) trained on the ACRIN 6684 dataset, a resource that contains paired MRI and FMISO PET images from patients with brain tumors. Our trained models effectively learn the complex relationships between the MRI features and the corresponding FMISO PET signals, thereby enabling the prediction of hypoxia from MRI scans alone. The results show a strong correlation between the predicted and actual FMISO PET signals, with an overall PSNR score above 29.6 and a SSIM score greater than 0.94, confirming MRI as a promising option for hypoxia prediction in brain tumors. This approach could significantly improve the accessibility of hypoxia detection in clinical settings, with the potential for more timely and targeted treatments.
Image and Video Processing,Artificial Intelligence
What problem does this paper attempt to address?
This paper mainly discusses how to use multiparametric magnetic resonance imaging (MRI) to predict hypoxia in brain tumors, replacing the expensive and less widespread 18F-fluoromisonidazole positron emission tomography (FMISO PET). The study proposes a deep learning model, which is trained on the ACRIN 6684 dataset that consists of paired MRI and FMISO PET images. By learning the complex relationship between MRI features and FMISO PET signals, the model is able to predict hypoxia status solely from MRI scans. The research shows that the predicted FMISO PET signals have a high correlation with the actual signals, with high peak signal-to-noise ratio (PSNR) and structural similarity index (SSIM). This validates MRI as a feasible method for predicting hypoxia in brain tumors. This approach may improve the accessibility of hypoxia detection in a clinical setting and contribute to more timely and targeted treatment decisions. The paper also reviews related work, including image-to-image translation techniques and MRI-to-PET image conversion, and compares with other deep learning models. The experimental results demonstrate that the 3D version of the ResViT model performs the best in predicting FMISO PET signals, especially for tumor regions. Furthermore, using multiple channels of MRI can improve the overall quality of predictions and the accuracy of tumor regions. Future research plans to explore whether models combining functional and physiological series of images, such as diffusion, perfusion, T2* or BOLD images, can further improve the prediction accuracy. These findings will be validated in a larger sample size and in different types of brain tumor patients.