Abstract:Conventional positron emission tomography (PET) image reconstruction is achieved by the statistical iterative method. Deep learning provides another opportunity for speeding up the image reconstruction process. However, conventional deep learning-based image reconstruction requires a fully connected network for learning the Radon transform. The use of fully connected networks greatly complicated the network and increased hardware cost. In this study, we proposed a novel deep learning-based image reconstruction method by utilizing the DIRECT data partitioning method. The U-net structure with only convolutional layers was used in our approach. Patch-based model training and testing were used to achieve 3D reconstructions within current hardware limitations. Time-of-flight (TOF)-histoimages were first generated from the listmode data to replace conventional sinograms. Different projection angles were used as different channels in the input. A total of 15 patient data were used in this study. For each patient, the dynamic whole-body scanning protocol was used to expand the training dataset and a total of 372 separate scans were included. The leave-one-patient-out validation method was used. Two separate studies were carried out. In the first study, the measured TOF-histoimages were directly used for model training and testing, to study the performance of the method in real-world applications. In the second study, TOF-histoimages were simulated from already reconstructed images to exclude the scatters, randoms, attenuation-activity mismatch effects. This study was used to evaluate the optimal performance when all other corrections are ideal. Volumes of interests were placed in the liver and lesion region to study image noise and lesion quantitations. The reconstructed images using the proposed deep learning method showed similar image quality when compared with the conventional expectation-maximization approach. A minimal difference was observed when the simulated TOF-histoimages were used as model input and testing, suggesting the deep learning model can indeed learn the reconstruction process. Some quantitative difference was observed when the measured TOF-histoimages were used. The two studies suggested that the major difference is caused by inaccurate corrections performed by the network itself, which indicated that physics-based corrections are still required for better quantitative performance. In conclusion, we have proposed a novel deep learning-based image reconstruction method for TOF PET. With the help of the DIRECT data partitioning method, no fully connected layers were used and 3D image reconstruction can be directly achieved within the limits of the current hardware.

TriDo-Former: A Triple-Domain Transformer for Direct PET Reconstruction from Low-Dose Sinograms

Direct Reconstruction and Separation for Triple-Tracer PET Imaging Based on Three-Dimensional Encoder-Decoder Network

End-to-end Triple-domain PET Enhancement: A Hybrid Denoising-and-reconstruction Framework for Reconstructing Standard-dose PET Images from Low-dose PET Sinograms

A Resource-Efficient Deep Learning Framework for Low-Dose Brain PET Image Reconstruction and Analysis

Rethinking PET Image Reconstruction: Ultra-Low-Dose, Sinogram and Deep Learning

Three-dimensional Convolutional Neural Networks for Simultaneous Dual-Tracer PET Imaging

PET Image Reconstruction with Parallax Correction Based on a Distance-Driven Deep Neural Network

Deep Learning Based Framework for Direct Reconstruction of PET Images

Dual-tracer PET Image Direct Reconstruction and Separation Based on Three-Dimensional Encoder-Decoder Network

Direct Reconstruction for Simultaneous Dual-Tracer PET Imaging Based on Multi-Task Learning

TransEM: Residual Swin-Transformer Based Regularized PET Image Reconstruction

Dynamic Low-Count PET Image Reconstruction Using Spatio-Temporal Primal Dual Network.

Temporal Image Sequence Separation in Dual-Tracer Dynamic PET with an Invertible Network

3D multi-modality Transformer-GAN for high-quality PET reconstruction

Spatiotemporal Attention Constrained Deep Learning Framework for Dual-Tracer PET Imaging

Diffusion Transformer Model With Compact Prior for Low-dose PET Reconstruction

Deep Dual-Domain Based Framework for PET Image Reconstruction

DDPTransformer: Dual-Domain With Parallel Transformer Network for Sparse View CT Image Reconstruction

Multiscale Deep-Learning Network Based Reconstruction of PET Images from Sinogram Domain

DuDoTrans: Dual-Domain Transformer for Sparse-View CT Reconstruction

Deep Learning-Based Image Reconstruction for TOF PET with DIRECT Data Partitioning Format.