Abstract:576 Objectives: As PET suffers from low resolution and high noise, numerous efforts try to incorporate anatomical priors into PET image reconstruction. In this work, we proposed a novel 3D structural convolutional sparse coding (CSC) framework for penalized-likelihood PET image reconstruction, named 3D PET-CSC. The proposed 3D PET-CSC takes advantage of the convolutional operation and manages to incorporate anatomical priors without the need of registration or supervised training. As 3D PET-CSC codes the whole 3D PET image, instead of patches, it alleviates the staircase artifacts commonly presented in traditional patch-based sparse coding methods. Methods: The schematic plot of proposed PET-CSC framework is shown in Fig.1(A). During the training phase, 3D convolutional kernels were iteratively learnt from the 3D MRI image, which incorporates the structural information from a higher resolution. During the coding phase, the PET image was represented by the multiplication of the learned kernels and feature map. The MRI image was based on the Brainweb database. The 18F-FDG brain PET data was acquired from the 5-ring GE Discovery MI PET/CT scanner with an acquisition time of 30 min. T415×1981×272.The reconstructed image size is 128×128×89 and the voxel size is 2×2×2.8 mm3. For bias quantification purposes, we inserted a simulated tumor with diameter of 14 mm near the boundary of the white and gray matter, and down-sampled the 30-min dataset to 1/20 of its original count to generate 10 low-count realizations. Results: The proposed method can robustly recover PET image with higher contrast and less noise, as presented in Fig.1(B). According to Fig.1(C), in contrast to traditional patch-based dictionary learning method, the convolutional sparse coding was conducted on the whole image, which can alleviate the artifacts from the patches’ aggregation.Conclusion: We have proposed a novel 3D CSC regularization into 3D PET image reconstruction. Based on the clinical datasets, we can see that the proposed 3D PET-CSC can efficiently and robustly incorporate the anatomical prior into PET reconstruction without the need of registration and training. Compared with the traditional dictionary learning method, the proposed method can produce PET images with higher quality.Acknowledgements: This work was supported by NIH grants R01 AG052653.

3D multi-modality Transformer-GAN for high-quality PET reconstruction

A Resource-Efficient Deep Learning Framework for Low-Dose Brain PET Image Reconstruction and Analysis

Multiscale Deep-Learning Network Based Reconstruction of PET Images from Sinogram Domain

TCGAN: a transformer-enhanced GAN for PET synthetic CT

PET Image Reconstruction with Parallax Correction Based on a Distance-Driven Deep Neural Network

Three-dimensional Convolutional Neural Networks for Simultaneous Dual-Tracer PET Imaging

3d Structural Convolutional Sparse Coding For Pet Image Reconstruction

Deep-learning Based Joint Estimation of Dual-Tracer PET Image Activity Maps and Clustering of Time Activity Curves

Deep Learning Based Framework for Direct Reconstruction of PET Images

Direct Reconstruction for Simultaneous Dual-Tracer PET Imaging Based on Multi-Task Learning

AIGAN: Attention-encoding Integrated Generative Adversarial Network for the Reconstruction of Low-Dose CT and Low-Dose PET Images

DRGAN: a Deep Residual Generative Adversarial Network for PET Image Reconstruction

MAG-Net: A Multi-Scale Adaptive Generation Network for PET Synthetic CT

Synthesizing PET Scans Using Attention GAN Based on MRI Scans and Alzheimer's Disease Information.

Image2Points:A 3D Point-based Context Clusters GAN for High-Quality PET Image Reconstruction

Cross-Modal PET Synthesis Method Based on Improved Edge-Aware Generative Adversarial Network

End-to-end Triple-domain PET Enhancement: A Hybrid Denoising-and-reconstruction Framework for Reconstructing Standard-dose PET Images from Low-dose PET Sinograms

CG-3DSRGAN: A classification guided 3D generative adversarial network for image quality recovery from low-dose PET images

DSG-GAN:A Dual-Stage-generator-based GAN for Cross-Modality Synthesis from PET to CT

Spach Transformer: Spatial and Channel-wise Transformer Based on Local and Global Self-attentions for PET Image Denoising