Abstract:Conventional positron emission tomography (PET) image reconstruction is achieved by the statistical iterative method. Deep learning provides another opportunity for speeding up the image reconstruction process. However, conventional deep learning-based image reconstruction requires a fully connected network for learning the Radon transform. The use of fully connected networks greatly complicated the network and increased hardware cost. In this study, we proposed a novel deep learning-based image reconstruction method by utilizing the DIRECT data partitioning method. The U-net structure with only convolutional layers was used in our approach. Patch-based model training and testing were used to achieve 3D reconstructions within current hardware limitations. Time-of-flight (TOF)-histoimages were first generated from the listmode data to replace conventional sinograms. Different projection angles were used as different channels in the input. A total of 15 patient data were used in this study. For each patient, the dynamic whole-body scanning protocol was used to expand the training dataset and a total of 372 separate scans were included. The leave-one-patient-out validation method was used. Two separate studies were carried out. In the first study, the measured TOF-histoimages were directly used for model training and testing, to study the performance of the method in real-world applications. In the second study, TOF-histoimages were simulated from already reconstructed images to exclude the scatters, randoms, attenuation-activity mismatch effects. This study was used to evaluate the optimal performance when all other corrections are ideal. Volumes of interests were placed in the liver and lesion region to study image noise and lesion quantitations. The reconstructed images using the proposed deep learning method showed similar image quality when compared with the conventional expectation-maximization approach. A minimal difference was observed when the simulated TOF-histoimages were used as model input and testing, suggesting the deep learning model can indeed learn the reconstruction process. Some quantitative difference was observed when the measured TOF-histoimages were used. The two studies suggested that the major difference is caused by inaccurate corrections performed by the network itself, which indicated that physics-based corrections are still required for better quantitative performance. In conclusion, we have proposed a novel deep learning-based image reconstruction method for TOF PET. With the help of the DIRECT data partitioning method, no fully connected layers were used and 3D image reconstruction can be directly achieved within the limits of the current hardware.

Physics-driven Deep Learning for PET/MRI

Physics-Driven Deep Learning for Computational Magnetic Resonance Imaging: Combining physics and machine learning for improved medical imaging

Deep Dual-Domain Based Framework for PET Image Reconstruction

Deep Reconstruction Model For Dynamic Pet Images

PET Image Reconstruction with Parallax Correction Based on a Distance-Driven Deep Neural Network

Deep Learning Based Framework for Direct Reconstruction of PET Images

Simultaneous Reconstruction and Segmentation of Dynamic Pet Via Low-Rank and Sparse Matrix Decomposition

Improved Patlak Reconstruction from Low-dose Dynamic PET Using Temporal Non-local Neural Network

PILOT: Physics-Informed Learned Optimized Trajectories for Accelerated MRI

Data- and Physics-driven Deep Learning Based Reconstruction for Fast MRI: Fundamentals and Methodologies

Rethinking PET Image Reconstruction: Ultra-Low-Dose, Sinogram and Deep Learning

Pet Image Resolution Uniformity Improvements Using Deep Learning

Deep learning techniques in PET/CT imaging: A comprehensive review from sinogram to image space

Artificial Intelligence and Deep Learning for Advancing PET Image Reconstruction: State-of-the-Art and Future Directions

Dynamic Low-Count PET Image Reconstruction Using Spatio-Temporal Primal Dual Network.

Deep Learning-Based Image Reconstruction for TOF PET with DIRECT Data Partitioning Format.

Data and Physics driven Deep Learning Models for Fast MRI Reconstruction: Fundamentals and Methodologies

Machine Learning in Quantitative PET: A Review of Attenuation Correction and Low-Count Image Reconstruction Methods

Sparse/Low Rank Constrained Reconstruction for Dynamic PET Imaging.

Improving the Timing Resolution of Positron Emission Tomography Detectors Using Boosted Learning -- A Residual Physics Approach

CT-guided PET Parametric Image Reconstruction Using Deep Neural Network Without Prior Training Data