Abstract:Conventional positron emission tomography (PET) image reconstruction is achieved by the statistical iterative method. Deep learning provides another opportunity for speeding up the image reconstruction process. However, conventional deep learning-based image reconstruction requires a fully connected network for learning the Radon transform. The use of fully connected networks greatly complicated the network and increased hardware cost. In this study, we proposed a novel deep learning-based image reconstruction method by utilizing the DIRECT data partitioning method. The U-net structure with only convolutional layers was used in our approach. Patch-based model training and testing were used to achieve 3D reconstructions within current hardware limitations. Time-of-flight (TOF)-histoimages were first generated from the listmode data to replace conventional sinograms. Different projection angles were used as different channels in the input. A total of 15 patient data were used in this study. For each patient, the dynamic whole-body scanning protocol was used to expand the training dataset and a total of 372 separate scans were included. The leave-one-patient-out validation method was used. Two separate studies were carried out. In the first study, the measured TOF-histoimages were directly used for model training and testing, to study the performance of the method in real-world applications. In the second study, TOF-histoimages were simulated from already reconstructed images to exclude the scatters, randoms, attenuation-activity mismatch effects. This study was used to evaluate the optimal performance when all other corrections are ideal. Volumes of interests were placed in the liver and lesion region to study image noise and lesion quantitations. The reconstructed images using the proposed deep learning method showed similar image quality when compared with the conventional expectation-maximization approach. A minimal difference was observed when the simulated TOF-histoimages were used as model input and testing, suggesting the deep learning model can indeed learn the reconstruction process. Some quantitative difference was observed when the measured TOF-histoimages were used. The two studies suggested that the major difference is caused by inaccurate corrections performed by the network itself, which indicated that physics-based corrections are still required for better quantitative performance. In conclusion, we have proposed a novel deep learning-based image reconstruction method for TOF PET. With the help of the DIRECT data partitioning method, no fully connected layers were used and 3D image reconstruction can be directly achieved within the limits of the current hardware.

Deep-learning approach to stratified reconstructions of tissue absorption and scattering in time-domain spatial frequency domain imaging

Wavefront Reconstruction Based on Deep Transfer Learning for Microscopy.

Deep Tissue Focusing Based on Machine Learning

Deep Learning Model for Ultrafast Multifrequency Optical Property Extractions for Spatial Frequency Domain Imaging.

Deep Non-line-of-sight Imaging from Under-scanning Measurements.

Deep Ensemble Model for Quantitative Optical Property and Chromophore Concentration Images of Biological Tissues

Ultracompact Deep Neural Network for Ultrafast Optical Property Extraction in Spatial Frequency Domain Imaging (SFDI)

Deep Learning-Based Image Reconstruction for TOF PET with DIRECT Data Partitioning Format.

Overcoming tissue scattering in wide-field deep imaging by extended detection and computational reconstruction

Direct mapping from diffuse reflectance to chromophore concentrations in multi-fx spatial frequency domain imaging (SFDI) with a deep residual network (DRN)

Physics-guided Deep Learning-Based Real-Time Image Reconstruction of Fourier-domain Optical Coherence Tomography.

Deep learning-enabled high-speed, multi-parameter diffuse optical tomography

Overcoming tissue scattering in wide-field two-photon imaging by extended detection and computational reconstruction.

3D-deep optical learning: a multimodal and multitask reconstruction framework for optical molecular tomography

Deep Learning Based Time-Domain Inversion for High-Contrast Scatterers

Terahertz Spatio-Temporal Deep Learning Computed Tomography

Difference Imaging from Single Measurements in Diffuse Optical Tomography: a Deep Learning Approach

Frequency Domain Optical Tomography in Human Tissue

HDN:Hybrid Deep-learning and Non-line-of-sight Reconstruction Framework for Photoacoustic Brain Imaging

A Novel Method for Ultrasound Localization Microscopy Based on Temporal Correlation Through Deep Learning

Sparse Reconstruction of Optical Doppler Tomography Based on State Space Model