Abstract:110 Objectives: Deriving accurate attenuation maps for PET/MRI remains a challenging problem because voxel-wised signal intensities from MRI are unrelated to photon attenuation. In addition, MRI has a poor signal from bone and often with image artifacts at bone/air interfaces. With the capability of simultaneous data acquisition from PET and MRI data, it is desirable to use structural MRI data from a clinical sequence to directly guide PET attenuation correction (AC). This work proposes a deep-learning-based method to use routine T1-weighted MRI to directly aid PET AC without the need for an attenuation coefficient map. Methods: We propose a novel network architecture, called Two-Stream Pyramid Attention Network (TSPAN), which can utilize any structural MRI of a PET/MRI scan to aid direct AC PET estimation from non-AC (NAC) PET. The proposed network integrates a self-attention strategy into a pyramid network for deep salient feature extraction. CT-based AC PETs from the same subjects were used as the ground truth for network training. Two dedicated sub-networks with the same pyramid architecture design were used to process NAC PET and MRI, independently. The outputs of these two sub-networks were compared with the ground truth to calculate two independent loss terms which were the NAC-only loss and MRI-only loss. Since the feature maps obtained from these two sub-networks are complementary to each other, therefore, it is beneficial to combine them in a late fusion sub-network for final estimation. In the late fusion sub-network, the learned feature maps of each corresponding pyramid level were first concatenated and then highlighted by attention gates. The final loss was calculated by comparing the final PET estimation and the ground truth. Our network was trained using a 3D-patch-based method. In the testing stage, the final set of synthetic AC PET images was generated using patch-based prediction, followed by patch fusion. The trained network was tested on brain datasets from 21 patients using leave-one-out cross-validation. Standardized uptake value (SUV) differences between the MRI-aided AC PET estimation and the ground truth from the PET/CT of the same patients were quantitatively evaluated using metrics including mean absolute error (MAE) and mean error (ME), and normalized cross-correlation (NCC). Statistical analysis was performed to compare the differences between the MRI-aided AC PET estimation and the ground truth. Results: The AC PET images generated using the proposed MRI-aided method show great resemblance to the reference PET/CT images. The average MAE, ME, and NCC between MRI-aided AC PET and CT-based AC PET images in the whole brain for all patients were 4.09±0.71% and -1.52±0.28%, and 0.958±0.032, respectively. The average ME ranged from -3.68% to 3.66% for all contoured volumes of interest. There was no significant difference between the MRI-aided AC PETs and the reference PET/CTs. Conclusion: We have demonstrated an MRI-aided PET AC method using a novel two-stream pyramid attention network. Our results showed that the proposed method was able to generate highly accurate AC PET estimations comparable to conventional PET/CT derived AC maps. This new approach leveraged simultaneously acquired MRI data in the PET/MRI scans with the superior MRI soft-tissue contrast to improve AC PET estimation with precise organ boundary definition. This technique could be used for accurate PET attenuation and partial volume correction in combined/integrated PET/MRI imaging applications.

Development and task-based evaluation of a scatter-window projection and deep learning-based transmission-less attenuation compensation method for myocardial perfusion SPECT

CTLESS: A scatter-window projection and deep learning-based transmission-less attenuation compensation method for myocardial perfusion SPECT

A physics and learning-based transmission-less attenuation compensation method for SPECT

Post-reconstruction Attenuation Correction for SPECT Myocardium Perfusion Imaging Facilitated by Deep Learning-Based Attenuation Map Generation

“Virtual” attenuation correction: improving stress myocardial perfusion SPECT imaging using deep learning

Deep-learning-based estimation of attenuation map improves attenuation correction performance over direct attenuation estimation for myocardial perfusion SPECT

Deep learning-based attenuation correction in the image domain for myocardial perfusion SPECT imaging

Direct and Indirect Strategies of Deep-Learning-based Attenuation Correction for General Purpose and Dedicated Cardiac SPECT

Supplemental Transmission Aided Attenuation Correction for Quantitative Cardiac PET/MR

Clinical Feasibility of Deep Learning–Based Attenuation Correction Models for Tl-201 Myocardial Perfusion SPECT

Deep learning approach using SPECT-to-PET translation for attenuation correction in CT-less myocardial perfusion SPECT imaging

DeTransUnet: attenuation correction of gated cardiac images without structural information

CT-free Attenuation Correction for Dedicated Cardiac SPECT Using a 3D Dual Squeeze-and-excitation Residual Dense Network

Investigation of Direct and Indirect Approaches of Deep-Learning-Based Attenuation Correction for General Purpose and Dedicated Cardiac SPECT Scanners

Cross-domain Iterative Network for Simultaneous Denoising, Limited-angle Reconstruction, and Attenuation Correction of Low-dose Cardiac SPECT

PET Attenuation Correction Using MRI-aided Two-Stream Pyramid Attention Network

The effect of CT-based attenuation correction on the automatic perfusion score of myocardial perfusion imaging using a dedicated cardiac solid-state CZT SPECT/CT

Joint Denoising and Few-angle Reconstruction for Low-dose Cardiac SPECT Using a Dual-domain Iterative Network with Adaptive Data Consistency

Can patient-specific acquisition protocol improve performance on defect detection task in myocardial perfusion SPECT?

Improving perfusion defect detection with respiratory motion compensation in cardiac SPECT

Generative adversarial network-based attenuation correction for 99mTc-TRODAT-1 brain SPECT