Jack Peter Green, 1925–2007

K. Davis,D. Charney

DOI: https://doi.org/10.1038/SJ.NPP.1301517

2007-09-17

Neuropsychopharmacology

Abstract:

What problem does this paper attempt to address?

Unified Noise-aware Network for Low-count PET Denoising

Huidong Xie,Qiong Liu,Bo Zhou,Xiongchao Chen,Xueqi Guo,Chi Liu

2023-04-28

Abstract:As PET imaging is accompanied by substantial radiation exposure and cancer risk, reducing radiation dose in PET scans is an important topic. However, low-count PET scans often suffer from high image noise, which can negatively impact image quality and diagnostic performance. Recent advances in deep learning have shown great potential for recovering underlying signal from noisy counterparts. However, neural networks trained on a specific noise level cannot be easily generalized to other noise levels due to different noise amplitude and variances. To obtain optimal denoised results, we may need to train multiple networks using data with different noise levels. But this approach may be infeasible in reality due to limited data availability. Denoising dynamic PET images presents additional challenge due to tracer decay and continuously changing noise levels across dynamic frames. To address these issues, we propose a Unified Noise-aware Network (UNN) that combines multiple sub-networks with varying denoising power to generate optimal denoised results regardless of the input noise levels. Evaluated using large-scale data from two medical centers with different vendors, presented results showed that the UNN can consistently produce promising denoised results regardless of input noise levels, and demonstrate superior performance over networks trained on single noise level data, especially for extremely low-count data.

Image and Video Processing
Population and Individual Information Guided PET Image Denoising Using Deep Neural Network

Jianan Cui,Kuang Gong,Ning Guo,Chenxi Wu,Kyungsang Kim,Huafeng Liu,Quanzheng Li

DOI: https://doi.org/10.1117/12.2534901

2019-01-01

Abstract:Positron emission tomography (PET) images still suffer from low signal-to-noise ratio (SNR) due to various physical degradation factors. Recently deep neural networks (DNNs) have been successfully applied to medical image denoising tasks when large number of training pairs are available. Previously the deep image prior framework1 shows that individual information can be enough to train a denoising network, with noisy image itself as the training label. In this work, we propose to improve PET image quality by jointly employing population and individual information based on DNN. The population information was utilized by pre-training the network using a group of patients. The individual information was introduced during testing phase by fine-tuning the population-information-trained network. Unlike traditional DNN denoising, in this framework fine-tuning during testing phase is available as the noisy PET image itself was treated as the training label. Quantification results based on clinical PET/MR datasets containing thirty patients demonstrate that the proposed framework outperforms Gaussian, non-local mean and deep image prior denoising methods.
A Personalized Deep Learning Denoising Strategy for Low-Count PET Images

Qiong Liu,Hui Liu,Niloufar Mirian,Sijin Ren,Varsha Viswanath,Joel Karp,Suleman Surti,Chi Liu

DOI: https://doi.org/10.1088/1361-6560/ac783d

IF: 3.5

2022-01-01

Physics in Medicine and Biology

Abstract:Objective. Deep learning denoising networks are typically trained with images that are representative of the testing data. Due to the large variability of the noise levels in positron emission tomography (PET) images, it is challenging to develop a proper training set for general clinical use. Our work aims to develop a personalized denoising strategy for the low-count PET images at various noise levels. Approach. We first investigated the impact of the noise level in the training images on the model performance. Five 3D U-Net models were trained on five groups of images at different noise levels, and a one-size-fits-all model was trained on images covering a wider range of noise levels. We then developed a personalized weighting method by linearly blending the results from two models trained on 20%-count level images and 60%-count level images to balance the trade-off between noise reduction and spatial blurring. By adjusting the weighting factor, denoising can be conducted in a personalized and task-dependent way. Main results. The evaluation results of the six models showed that models trained on noisier images had better performance in denoising but introduced more spatial blurriness, and the one-size-fits-all model did not generalize well when deployed for testing images with a wide range of noise levels. The personalized denoising results showed that noisier images require higher weights on noise reduction to maximize the structural similarity and mean squared error. And model trained on 20%-count level images can produce the best liver lesion detectability. Significance. Our study demonstrated that in deep learning-based low dose PET denoising, noise levels in the training input images have a substantial impact on the model performance. The proposed personalized denoising strategy utilized two training sets to overcome the drawbacks introduced by each individual network and provided a series of denoised results for clinical reading.
A Noise-level-aware Framework for PET Image Denoising

Ye Li,Jianan Cui,Junyu Chen,Guodong Zeng,Scott Wollenweber,Floris Jansen,Se-In Jang,Kyungsang Kim,Kuang Gong,Quanzheng Li

DOI: https://doi.org/10.1007/978-3-031-17247-2_8

2022-03-16

Abstract:In PET, the amount of relative (signal-dependent) noise present in different body regions can be significantly different and is inherently related to the number of counts present in that region. The number of counts in a region depends, in principle and among other factors, on the total administered activity, scanner sensitivity, image acquisition duration, radiopharmaceutical tracer uptake in the region, and patient local body morphometry surrounding the region. In theory, less amount of denoising operations is needed to denoise a high-count (low relative noise) image than images a low-count (high relative noise) image, and vice versa. The current deep-learning-based methods for PET image denoising are predominantly trained on image appearance only and have no special treatment for images of different noise levels. Our hypothesis is that by explicitly providing the local relative noise level of the input image to a deep convolutional neural network (DCNN), the DCNN can outperform itself trained on image appearance only. To this end, we propose a noise-level-aware framework denoising framework that allows embedding of local noise level into a DCNN. The proposed is trained and tested on 30 and 15 patient PET images acquired on a GE Discovery MI PET/CT system. Our experiments showed that the increases in both PSNR and SSIM from our backbone network with relative noise level embedding (NLE) versus the same network without NLE were statistically significant with p<0.001, and the proposed method significantly outperformed a strong baseline method by a large margin.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning,Medical Physics
PET Image Denoising Using Unsupervised Deep Learning.

Jianan Cui,Kuang Gong,Ning Guo,Chenxi Wu,Xiaxia Meng,Kyungsang Kim,Kun Zheng,Zhifang Wu,Liping Fu,Baixuan Xu,Zhaohui Zhu,Jiahe Tian,Huafeng Liu,Quanzheng Li

DOI: https://doi.org/10.1007/s00259-019-04468-4

2019-01-01

Abstract:Image quality of positron emission tomography (PET) is limited by various physical degradation factors. Our study aims to perform PET image denoising by utilizing prior information from the same patient. The proposed method is based on unsupervised deep learning, where no training pairs are needed. In this method, the prior high-quality image from the patient was employed as the network input and the noisy PET image itself was treated as the training label. Constrained by the network structure and the prior image input, the network was trained to learn the intrinsic structure information from the noisy image and output a restored PET image. To validate the performance of the proposed method, a computer simulation study based on the BrainWeb phantom was first performed. A 68Ga-PRGD2 PET/CT dataset containing 10 patients and a 18F-FDG PET/MR dataset containing 30 patients were later on used for clinical data evaluation. The Gaussian, non-local mean (NLM) using CT/MR image as priors, BM4D, and Deep Decoder methods were included as reference methods. The contrast-to-noise ratio (CNR) improvements were used to rank different methods based on Wilcoxon signed-rank test. For the simulation study, contrast recovery coefficient (CRC) vs. standard deviation (STD) curves showed that the proposed method achieved the best performance regarding the bias-variance tradeoff. For the clinical PET/CT dataset, the proposed method achieved the highest CNR improvement ratio (53.35% ± 21.78%), compared with the Gaussian (12.64% ± 6.15%, P = 0.002), NLM guided by CT (24.35% ± 16.30%, P = 0.002), BM4D (38.31% ± 20.26%, P = 0.002), and Deep Decoder (41.67% ± 22.28%, P = 0.002) methods. For the clinical PET/MR dataset, the CNR improvement ratio of the proposed method achieved 46.80% ± 25.23%, higher than the Gaussian (18.16% ± 10.02%, P < 0.0001), NLM guided by MR (25.36% ± 19.48%, P < 0.0001), BM4D (37.02% ± 21.38%, P < 0.0001), and Deep Decoder (30.03% ± 20.64%, P < 0.0001) methods. Restored images for all the datasets demonstrate that the proposed method can effectively smooth out the noise while recovering image details. The proposed unsupervised deep learning framework provides excellent image restoration effects, outperforming the Gaussian, NLM methods, BM4D, and Deep Decoder methods.
The Impact of Noise Level Mismatch Between Training and Testing Images for Deep Learning-Based PET Denoising

Qiong Liu,Hui Liu,Mirian Niloufar,Sijin Ren,Chi Liu

2021-01-01

Journal of Nuclear Medicine

Abstract:109 Objectives: Deep-learning methods have been applied in PET image denoising. However, when the noise level in the training and testing images are different, a deep-learning model could introduce spatial blurring and affect denoising performance. In this study, the impact of the unmatched noise level in training and testing images for denoising low dose PET images was investigated and potential solutions are proposed. Methods: 168 patients 18F-FDG images acquired on a Siemens mCT PET/CT were included in this study. Low-count PET images were generated by rebinning the list-mode data at 20% (2 samples), 40% (2 samples), and 60% (1 sample) by uniform down-sampling. Among all patients, 100 studies were randomly selected as the training datasets, and the rest as testing data. 500 training images (100 patients x 5 count samples) were sorted into five noise level groups, which were surrogated by the image-based measurement of normalized standard deviation (NSTD) within a 3-cm diameter 3D spherical ROI within the liver. 340 testing images (68 patients x 5 count samples) were sorted into 5 groups with the same NSTD range in the training groups. The NSTD ranges in each group are 0-0.12, 0.12-0.14, 0.14-0.17, 0.17-0.20, 0.20-0.50. Models trained on each group were named with the corresponding group number, e.g. Model 1 was trained on Group 1 images. Model/Group 1 corresponded to the lowest noise group while Model/Group 5 corresponded to the highest noise group. We also applied a control group covering the full range of noise level with NSTD of 0-0.5, and the model trained on this group was named as ModelAll. 3D U-Net was used in this study. The total numbers of images in each group are the same with 100 noisy images as input and the corresponding full-dose images as the label. Mean squared error (MSE), peak signal to noise ratio (PSNR), and structural similarity (SSIM) as compared to full-dose images were used for evaluation. Results: For each group, different U-Net models resulted in denoised images with different tradeoffs between noise reduction and resolution. Trained on less noisy images and tested on noisier images, the model showed limited denoising performance but better preserved resolution. Trained on noisier images and tested on less noisy images, the model achieved greater noise reduction but introduced substantial blurring. Models 2, 3, and 4 led to the highest SSIM for Groups 2, 3, and 4 testing images, respectively, while such a trend is not clear for MSE and PSNR. Among all the evaluation parameters, ModelAll did not outperform other individual models on all the testing groups. Conclusions: Unmatched training and testing datasets resulted in different trade-offs between denoising and preserving resolution. Our results suggested that U-Net models trained on images with noise level ranges that match with those of testing images are generally desirable, though different imaging tasks and evaluation metrics could require different optimized models. A one-size-fits-all model trained with all noise levels is not recommended. A personalized strategy is needed for deep learning-based PET denoising.
An Investigation of Quantitative Accuracy for Deep Learning Based Denoising in Oncological PET.

Wenzhuo Lu,John A. Onofrey,Yihuan Lu,Luyao Shi,Tianyu Ma,Yaqiang Liu,Chi Liu

DOI: https://doi.org/10.1088/1361-6560/ab3242

IF: 3.5

2019-01-01

Physics in Medicine and Biology

Abstract:Reducing radiation dose is important for PET imaging. However, reducing injection doses causes increased image noise and low signal-to-noise ratio (SNR), subsequently affecting diagnostic and quantitative accuracies. Deep learning methods have shown a great potential to reduce the noise and improve the SNR in low dose PET data. In this work, we comprehensively investigated the quantitative accuracy of small lung nodules, in addition to visual image quality, using deep learning based denoising methods for oncological PET imaging. We applied and optimized an advanced deep learning method based on the U-net architecture to predict the standard dose PET image from 10% low-dose PET data. We also investigated the effect of different network architectures, image dimensions, labels and inputs for deep learning methods with respect to both noise reduction performance and quantitative accuracy. Normalized mean square error (NMSE), SNR, and standard uptake value (SUV) bias of different nodule regions of interest (ROIs) were used for evaluation. Our results showed that U-net and GAN are superior to CAE with smaller SUVmean and SUVmax bias at the expense of inferior SNR. A fully 3D U-net has optimal quantitative performance compared to 2D and 2.5D U-net with less than 15% SUVmean bias for all the ten patients. U-net outperforms Residual U-net (r-U-net) in general with smaller NMSE, higher SNR and lower SUVmax bias. Fully 3D U-net is superior to several existing denoising methods, including Gaussian filter, anatomical-guided non-local mean (NLM) filter, and MAP reconstruction with Quadratic prior and relative difference prior, in terms of superior image quality and trade-off between noise and bias. Furthermore, incorporating aligned CT images has the potential to further improve the quantitative accuracy in multi-channel U-net. We found the optimal architectures and parameters of deep learning based methods are different for absolute quantitative accuracy and visual image quality. Our quantitative results demonstrated that fully 3D U-net can both effectively reduce image noise and control bias even for sub-centimeter small lung nodules when generating standard dose PET using 10% low count down-sampled data.
Deep Learning-Based Denoising for PennPET Explorer Data

Jing Wu,Margaret Daube-Witherspoon,Hui Liu,Wenzhuo Lu,John Onofrey,Joel Karp,Chi Liu

2019-01-01

Abstract:574 Objectives: Promising results have been reported for low-statistics PET data denoising using a deep convolutional neural network (CNN) with standard-statistics images as the target and low-statistics images as input for training. The trained network can generate denoised low-statistics images, which have similar noise level as the standard-statistics images. The long axial field-of-view (AFOV) scanner of the PennPET Explorer leads to very high sensitivity and permits low dose, fast, and/or late imaging. A CNN trained on the high-count data from the PennPET scanner will be able to generate virtual-high-statistics images to permit ultra-low dose, ultra-fast, and/or ultra-late imaging. In this study, we investigated and optimized a fully 3D U-Net architecture for the PennPET Explorer data denoising. Methods: Two subjects were injected with 15 mCi FDG and scanned in a single bed position on the time-of-flight (TOF) PennPET Explorer scanner (currently with 64-cm AFOV). Subject #1 was scanned for 20 min after 105 min post-injection. Subject #2 was scanned for 20 min after 85 min post-injection, and then an ultra-late scan was acquired for 60 min after 10 half-lives of FDG (~18 hr post-injection). For each subject, 10 low-count (5% of full count, 1-min data) samples were generated by independent sampling from the full-count (20-min) data. All the images were reconstructed by list-mode TOF OSEM (25 subsets, 4 iterations). The image size was 288×288×320 with voxel size of 2×2×2 mm3, and then cropped to 144×272×320 for denoising. A fully 3D U-Net was trained for denoising by minimizing the L2 loss function using Adam optimization. The 10 low-count and 1 full-count images from subject #1 were used as input and target for training, respectively, and the 10 low-count images from subject #2 were used for testing. To augment the training dataset, a patch-based method was used with 64×64×16 patch size. To reduce artifacts on the tile edge caused by the overlapping-tile strategy, 144×272×160 patch size was used in testing. Regions of interest (ROIs) of cerebellum, bone marrow, myocardium, aorta wall, and lung were drawn on the full-count image of subject #2. The quantification accuracy was evaluated using the relative bias of ROI mean value with the full-count image as ground truth. The background noise was evaluated using the normalized standard deviation in the lung ROI. Finally, the trained network was applied to the ultra-late scan of subject #2 to generate a low-noise virtual-high-statistics image. Results: The trained 3D U-Net can generate denoised low-count images, which have comparable image quality as the full-count image. The aorta wall can be clearly identified in the denoised images, but not in the original low-count images. The quantification results showed that the noise levels in the low-count images were greatly reduced by a factor of about 4.5 after denoising, which were similar to that in the full-count image. The relative bias values in all ROIs were below 6% in the denoised low-count images. Finally, a low-noise virtual-high-statistics ultra-late image was generated using this optimized 3D U-Net, though further network training might be needed using images with matched noise levels in ultra-late scans. Conclusions: Fully 3D U-Net is able to predict full-count images from low-count data acquired on the PennPET Explorer scanner, although additional human data are needed to further optimize the network. The high sensitivity of long AFOV scanners coupled with an optimized CNN, may permit ultra-low dose, ultra-fast and/or ultra-late imaging. The optimized 3D U-Net can be further used for generating high quality images for ultra-late scans, which may enable significant clinical and research applications.
Dynamic Low-Count PET Image Reconstruction Using Spatio-Temporal Primal Dual Network.

Rui Hu,Jianan Cui,Chenxu Li,Chengjin Yu,Yunmei Chen,Huafeng Liu

DOI: https://doi.org/10.1088/1361-6560/acde3e

IF: 3.5

2023-01-01

Physics in Medicine and Biology

Abstract:Objective.Dynamic positron emission tomography (PET) imaging, which can provide information on dynamic changes in physiological metabolism, is now widely used in clinical diagnosis and cancer treatment. However, the reconstruction from dynamic data is extremely challenging due to the limited counts received in individual frame, especially in ultra short frames. Recently, the unrolled model-based deep learning methods have shown inspiring results for low-count PET image reconstruction with good interpretability. Nevertheless, the existing model-based deep learning methods mainly focus on the spatial correlations while ignore the temporal domain.Approach.In this paper, inspired by the learned primal dual (LPD) algorithm, we propose the spatio-temporal primal dual network (STPDnet) for dynamic low-count PET image reconstruction. Both spatial and temporal correlations are encoded by 3D convolution operators. The physical projection of PET is embedded in the iterative learning process of the network, which provides the physical constraints and enhances interpretability.Main results.The experiments of both simulation data and real rat scan data have shown that the proposed method can achieve substantial noise reduction in both temporal and spatial domains and outperform the maximum likelihood expectation maximization, spatio-temporal kernel method, LPD and FBPnet.Significance.Experimental results show STPDnet better reconstruction performance in the low count situation, which makes the proposed method particularly suitable in whole-body dynamic imaging and parametric PET imaging that require extreme short frames and usually suffer from high level of noise.
PET Denoising and Uncertainty Estimation Based on NVAE Model

Jianan Cui,Yutong Xie,Kuang Gong,Kyungsang Kim,Jaewon Yang,Peder Larson,Thomas Hope,Spencer Behr,Youngho Seo,Huafeng Liu,Quanzheng Li

DOI: https://doi.org/10.1109/nss/mic44867.2021.9875487

2021-01-01

Abstract:The structure of the deep neural network is constantly changing, and its performance is constantly breaking through. Recently, a new network, Nouveau variational auto-encoder (NVAE), has been proposed and gained great attention. In addition to the ability to generate high-quality images, the more important nature of NVAE is that it can generate a distribution that makes it possible to measure the uncertainty. In this work, we proposed to use NVAE for PET image denoising and estimate the uncertainty from both training data and model at the same time. 2.5D training based on 28 patients was performed and quantification based on 7 real patient data showed that NVAE has a good performance for PET denoising, which outperforms the Unet. The variance of 1000 sample output was calculated to show the uncertainty map.
CT-guided PET Image Denoising Using Deep Neural Network Without Prior Training Data

Jianan Cui,Kuang Gong,Ning Guo,Xiaxia Meng,Kyungsang Kim,Huafeng Liu,Quanzheng Li

DOI: https://doi.org/10.1109/nssmic.2018.8824397

2018-01-01

Abstract:Deep neural network have been a powerful tool for computer vision tasks and generally used in medical image [1]-[4].
PET Denoising and Uncertainty Estimation Based on NVAE Model Using Quantile Regression Loss

Jianan Cui,Yutong Xie,Anand A. Joshi,Kuang Gong,Kyungsang Kim,Young-Don Son,Jong-Hoon Kim,Richard Leahy,Huafeng Liu,Quanzheng Li

DOI: https://doi.org/10.1007/978-3-031-16440-8_17

2022-01-01

Abstract:Deep learning-based methods have shown their superior performance for medical imaging, but their clinical application is still rare. One reason may come from their uncertainty. As data-driven models, deep learning-based methods are sensitive to imperfect data. Thus, it is important to quantify the uncertainty, especially for positron emission tomography (PET) denoising tasks where the noise is very similar to small tumors. In this paper, we proposed a Nouveau variational autoencoder (NVAE) based model using quantile regression loss for simultaneous PET image denoising and uncertainty estimation. Quantile regression loss was performed as the reconstruction loss to avoid the variance shrinkage problem caused by the traditional reconstruction probability loss. The variance and mean can be directly calculated from the estimated quantiles under the Logistic assumption, which is more efficient than Monte Carlo sampling. Experiment based on real 11 C-DASB datasets verified that the denoised PET images of the proposed method have a higher mean(+/- SD) peak signal-to-noise ratio (PSNR) (40.64 +/- 5.71) and structural similarity index measure (SSIM) (0.9807 +/- 0.0063) than Unet-based denoising (PSNR, 36.18 +/- 5.55; SSIM, 0.9614 +/- 0.0121) and NVAE model using Monte Carlo sampling (PSNR, 37.00 +/- 5.35; SSIM, 0.9671 +/- 0.0095) methods.
Noise‐assisted hybrid attention networks for low‐dose PET and CT denoising

Hengzhi Xue,Yudong Yao,Yueyang Teng

DOI: https://doi.org/10.1002/mp.17430

IF: 4.506

2024-10-23

Medical Physics

Abstract:Background Positron emission tomography (PET) and computed tomography (CT) play a vital role in tumor‐related medical diagnosis, assessment, and treatment planning. However, full‐dose PET and CT pose the risk of excessive radiation exposure to patients, whereas low‐dose images compromise image quality, impacting subsequent tumor recognition and disease diagnosis. Purpose To solve such problems, we propose a Noise‐Assisted Hybrid Attention Network (NAHANet) to reconstruct full‐dose PET and CT images from low‐dose PET (LDPET) and CT (LDCT) images to reduce patient radiation risks while ensuring the performance of subsequent tumor recognition. Methods NAHANet contains two branches: the noise feature prediction branch (NFPB) and the cascaded reconstruction branch. Among them, NFPB providing noise features for the cascade reconstruction branch. The cascaded reconstruction branch comprises a shallow feature extraction module and a reconstruction module which contains a series of cascaded noise feature fusion blocks (NFFBs). Among these, the NFFB fuses the features extracted from low‐dose images with the noise features obtained by NFPB to improve the feature extraction capability. To validate the effectiveness of the NAHANet method, we performed experiments using two public available datasets: the Ultra‐low Dose PET Imaging Challenge dataset and Low Dose CT Grand Challenge dataset. Results As a result, the proposed NAHANet achieved higher performance on common indicators. For example, on the CT dataset, the PSNR and SSIM indicators were improved by 4.1 dB and 0.06 respectively, and the rMSE indicator was reduced by 5.46 compared with the LDCT; on the PET dataset, the PSNR and SSIM was improved by 3.37 dB and 0.02, and the rMSE was reduced by 9.04 compared with the LDPET. Conclusions This paper proposes a transformer‐based denoising algorithm, which utilizes hybrid attention to extract high‐level features of low dose images and fuses noise features to optimize the denoising performance of the network, achieving good performance improvements on low‐dose CT and PET datasets.

radiology, nuclear medicine & medical imaging
Convolutional neural networks for improving image quality with noisy PET data

Josh Schaefferkoetter,Jianhua Yan,Claudia Ortega,Andrew Sertic,Eli Lechtman,Yael Eshet,Ur Metser,Patrick Veit-Haibach

DOI: https://doi.org/10.1186/s13550-020-00695-1

2020-09-21

Abstract:Goal: PET is a relatively noisy process compared to other imaging modalities, and sparsity of acquisition data leads to noise in the images. Recent work has focused on machine learning techniques to improve PET images, and this study investigates a deep learning approach to improve the quality of reconstructed image volumes through denoising by a 3D convolution neural network. Potential improvements were evaluated within a clinical context by physician performance in a reading task. Methods: A wide range of controlled noise levels was emulated from a set of chest PET data in patients with lung cancer, and a convolutional neural network was trained to denoise the reconstructed images using the full-count reconstructions as the ground truth. The benefits, over conventional Gaussian smoothing, were quantified across all noise levels by observer performance in an image ranking and lesion detection task. Results: The CNN-denoised images were generally ranked by the physicians equal to or better than the Gaussian-smoothed images for all count levels, with the largest effects observed in the lowest-count image sets. For the CNN-denoised images, overall lesion contrast recovery was 60% and 90% at the 1 and 20 million count levels, respectively. Notwithstanding the reduced lesion contrast recovery in noisy data, the CNN-denoised images also yielded better lesion detectability in low count levels. For example, at 1 million true counts, the average true positive detection rate was around 40% for the CNN-denoised images and 30% for the smoothed images. Conclusion: Significant improvements were found for CNN-denoising for very noisy images, and to some degree for all noise levels. The technique presented here offered however limited benefit for detection performance for images at the count levels routinely encountered in the clinic.
Full-count PET Recovery from Low-count Image Using a Dilated Convolutional Neural Network

Karl Spuhler,Mario Serrano-Sosa,Renee Cattell,Christine DeLorenzo,Chuan Huang

DOI: https://doi.org/10.1002/mp.14402

2019-10-26

Abstract:Positron Emission Tomography (PET) is an essential technique in many clinical applications that allows for quantitative imaging at the molecular level. This study aims to develop a denoising method using novel dilated convolutional neural network to recover full-count images from low-count images. We adopted similar hierarchal structure from the conventional uNet and incorporated dilated kernels in each convolution to allow the network to observe larger, and perhaps, more robust, features within the image. Our dNet were trained alongside a uNet for comparison. Our 2.5D model used a training set (N=30) and testing set (N=5) that were obtained from an ongoing 18F-FDG study. Low-count PET data (10% count) were generated through Poisson thinning from the full listmode file. Both low-count PET and full-count PET were reconstructed with the OSEM algorithm. Objective imaging metrics including mean absolute percent error (MAPE), peak signal-to-noise ratio (PSNR) and structural similarity index metric (SSIM) were used to analyze the denoising methods. Both the uNet and our proposed dNet were successfully trained to synthesize full-count PET images from low-count PET images. Compared to low-count PET, both the uNet and dNet methods significantly improved MAPE, PSNR and SSIM. Our dNet also systematically outperformed uNet on all three metrics and across all testing subjects. This study proposed a novel approach of using dilated convolutions for recovering full-count PET images from low-count PET images. Our dNet significantly outperformed the well-established uNet and demonstrates great potential for denoising low-count PET images.

Medical Physics,Image and Video Processing
Cycle-Constrained Adversarial Denoising Convolutional Network for PET Image Denoising: Multi-Dimensional Validation on Large Datasets with Reader Study and Real Low-Dose Data

Yucun Hou,Fenglin Zhan,Xin Cheng,Chenxi Li,Ziquan Yuan,Runze Liao,Haihao Wang,Jianlang Hua,Jing Wu,Jianyong Jiang

2024-10-31

Abstract:Positron emission tomography (PET) is a critical tool for diagnosing tumors and neurological disorders but poses radiation risks to patients, particularly to sensitive populations. While reducing injected radiation dose mitigates this risk, it often compromises image quality. To reconstruct full-dose-quality images from low-dose scans, we propose a Cycle-constrained Adversarial Denoising Convolutional Network (Cycle-DCN). This model integrates a noise predictor, two discriminators, and a consistency network, and is optimized using a combination of supervised loss, adversarial loss, cycle consistency loss, identity loss, and neighboring Structural Similarity Index (SSIM) loss. Experiments were conducted on a large dataset consisting of raw PET brain data from 1,224 patients, acquired using a Siemens Biograph Vision PET/CT scanner. Each patient underwent a 120-seconds brain scan. To simulate low-dose PET conditions, images were reconstructed from shortened scan durations of 30, 12, and 5 seconds, corresponding to 1/4, 1/10, and 1/24 of the full-dose acquisition, respectively, using a custom-developed GPU-based image reconstruction software. The results show that Cycle-DCN significantly improves average Peak Signal-to-Noise Ratio (PSNR), SSIM, and Normalized Root Mean Square Error (NRMSE) across three dose levels, with improvements of up to 56%, 35%, and 71%, respectively. Additionally, it achieves contrast-to-noise ratio (CNR) and Edge Preservation Index (EPI) values that closely align with full-dose images, effectively preserving image details, tumor shape, and contrast, while resolving issues with blurred edges. The results of reader studies indicated that the images restored by Cycle-DCN consistently received the highest ratings from nuclear medicine physicians, highlighting their strong clinical relevance.

Image and Video Processing,Computer Vision and Pattern Recognition,Medical Physics
Rethinking PET Image Reconstruction: Ultra-Low-Dose, Sinogram and Deep Learning

Qiupeng Feng,Huafeng Liu

DOI: https://doi.org/10.1007/978-3-030-59728-3_76

2020-01-01

Abstract:Although Positron emission tomography (PET) has a wide range of clinical applications, radiation exposure to patients in PET continues to draw concerns. To reduce the radiation risk, efforts have been made to obtain high resolution images from low-resolution images. However, previous studies mainly focused on denoising PET images in image space, which ignored the influence of sinogram quality and constraints in reconstruction process. This paper proposed a directly reconstruction framework from ultra-low-dose sinogram based on deep learning. Two coupled networks are introduced to sequentially denoise low-dose sinogram and reconstruct the activity map. Evaluation on in vivo PET dataset indicates that the proposed method can achieve better performance than other state-of-the-art methods and reconstruct satisfactory PET images with only 0.2% dose of standard one.
POUR-Net: A Population-Prior-Aided Over-Under-Representation Network for Low-Count PET Attenuation Map Generation

Bo Zhou,Jun Hou,Tianqi Chen,Yinchi Zhou,Xiongchao Chen,Huidong Xie,Qiong Liu,Xueqi Guo,Yu-Jung Tsai,Vladimir Y. Panin,Takuya Toyonaga,James S. Duncan,Chi Liu

2024-01-26

Abstract:Low-dose PET offers a valuable means of minimizing radiation exposure in PET imaging. However, the prevalent practice of employing additional CT scans for generating attenuation maps (u-map) for PET attenuation correction significantly elevates radiation doses. To address this concern and further mitigate radiation exposure in low-dose PET exams, we propose POUR-Net - an innovative population-prior-aided over-under-representation network that aims for high-quality attenuation map generation from low-dose PET. First, POUR-Net incorporates an over-under-representation network (OUR-Net) to facilitate efficient feature extraction, encompassing both low-resolution abstracted and fine-detail features, for assisting deep generation on the full-resolution level. Second, complementing OUR-Net, a population prior generation machine (PPGM) utilizing a comprehensive CT-derived u-map dataset, provides additional prior information to aid OUR-Net generation. The integration of OUR-Net and PPGM within a cascade framework enables iterative refinement of $\mu$-map generation, resulting in the production of high-quality $\mu$-maps. Experimental results underscore the effectiveness of POUR-Net, showing it as a promising solution for accurate CT-free low-count PET attenuation correction, which also surpasses the performance of previous baseline methods.

Computer Vision and Pattern Recognition,Artificial Intelligence,Image and Video Processing
Investigation of Lesion Detectability Using Deep Learning Based Denoising Methods in Oncology PET: a Cross-Center Phantom Study

Hui Liu,Varsha Viswanath,Joel Karp,Chi Liu,Suleman Surti

2020-01-01

Abstract:430 Objectives: Previous studies have demonstrated promising performance in reducing noise in low-statistics PET images when using a deep convolutional neural network (CNN). While existing deep learning-based PET denoising studies have primarily focused on lesion quantification, this work investigates the impact of noise reduction with deep learning on lesion detectability for different noise levels based on a cross-center phantom study. Methods: For the deep learning network, we used a 3D U-Net trained by the datasets from 70 patients (age: 60.2 ± 22.7 years; BMI: 26.6 ± 4.9 kg/m2) acquired on a Biograph mCT scanner at Yale-New Haven Hospital (YNHH). The list-mode data were obtained for 15.9 ± 3.7 mins after 9.95 ± 0.81 mCi 18F-FDG injection with continuous-bed-motion whole-body scanning to generate the standard-statistics images using OSEM reconstruction with PSF and TOF modelling. Ten samples of low-statistics images were generated by 10% down-sampling of the list-mode data. Using the low-statistics images as input and the standard-statistics images as label, the network was trained to minimize a L2 loss function with the Adam optimizer. To investigate lesion detectability as a function of count statistics, the SNMMI CTN phantom filled with 18F-FDG was scanned on a mCT scanner at the University of Pennsylvania. In addition, a uniform cylinder phantom was used to emulate the liver. List-mode data were acquired for 60 minutes. Spherical lesions (9.89 mm diameter) were embedded into the phantoms data by combining the lesion data acquired separately in air with the list-mode data of the two phantoms. Images of six different noise levels (scan duration: 0.5, 1, 1.5, 2, 3 and 6 mins) were generated with 10 replicates for each noise level. The images were reconstructed using OSEM algorithm with PSF and TOF modeling. The denoised images were obtained using the U-Net trained by YNHH data. A generalized scan statistics methodology was used to determine the area under the LROC curve (ALROC) as a function of scan time for images without and with denoising to determine the improved lesion detectability with deep learning based noise reduction. Results: The noise of the CTN phantom images was effectively reduced by the U-Net for all noise levels. After noise reduction, the mean contrast and max contrast was reduced for all six noise levels in both liver and lung. However, benefiting from the reduced noise in the background, there was a substantial increase in the ALROC values for liver lesions. For lung lesions, the ALROC values derived from images without and with U-Net noise reduction were similar, likely due to the high contrast of the embedded lesions (6:1). Conclusions: Deep learning based noise reduction methods can improve the detectability of small lesions in low-statistics PET images.
An Adaptive Patch Sampling Scheme for Deep Learning Based PET Image Denoising

Jing Wu,Haoyan Tan,Hui Liu,Chi Liu,John A. Onofrey

DOI: https://doi.org/10.1109/nss/mic44845.2022.10399313

2022-01-01

Abstract:Deep learning-based approaches introduce over-smoothing effect in image denoising, degrading small-size tissue quantification. In this work, we investigated an adaptive patch sampling scheme to reduce this over-smoothing effect. Ten patients with solid lung nodules were included, each having one full-dose FDG PET image and 10 replicates of 10% low-dose PET image. For low-dose PET denoising, a patch-based strategy was used for data augmentation in training. Three networks were used: 1) 3D U-Net; 2) 3D U-Net with weighted patch sampling (U-Net-WSamp) by assigning higher sampling rate to the patches with nodule at the center during training, which can focus network training on nodule; 3) 3D U-Net with weighted loss (U-Net-WLoss), in which the L1 loss function was multiplied by a weight map with higher value for the voxels inside nodule. A "leave-one-out" approach was used to evaluate the networks across all 10 patients. The results showed all the three networks effectively reduced low-dose PET image noise. Their performances were similar in terms of normalized mean square error (NMSE), indicating that the strategy to focus training on nodules in both U-Net-WSamp and U-Net-WLoss did not degrade the denoising performance on the voxels outside nodules. U-Net-WSamp provided a slightly higher signal-to-noise ratio (SNR) than U-Net (3.44 ± 0.86 versus 3.41 ± 0.80) and U-Net-WLoss provided the highest SNR (3.57 ± 0.90). U-Net introduced over-smoothing effect and degraded nodule quantification with an absolute bias of 8.24% ± 4.13%. U-Net-WLoss was not able to reduce nodule bias (8.48% ± 3.36%). U-Net-WSamp caused less blurring effect than U-Net in the majority of the patients and reduced nodule bias to 7.86% ± 3.70%. In conclusion, the proposed adaptive patch sampling scheme can reduce the over-smoothing effect and improve nodule quantification in deep learning-based PET image denoising.

Jack Peter Green, 1925–2007

Unified Noise-aware Network for Low-count PET Denoising

Population and Individual Information Guided PET Image Denoising Using Deep Neural Network

A Personalized Deep Learning Denoising Strategy for Low-Count PET Images

A Noise-level-aware Framework for PET Image Denoising

PET Image Denoising Using Unsupervised Deep Learning.

The Impact of Noise Level Mismatch Between Training and Testing Images for Deep Learning-Based PET Denoising

An Investigation of Quantitative Accuracy for Deep Learning Based Denoising in Oncological PET.

Deep Learning-Based Denoising for PennPET Explorer Data

Dynamic Low-Count PET Image Reconstruction Using Spatio-Temporal Primal Dual Network.

PET Denoising and Uncertainty Estimation Based on NVAE Model

CT-guided PET Image Denoising Using Deep Neural Network Without Prior Training Data

PET Denoising and Uncertainty Estimation Based on NVAE Model Using Quantile Regression Loss

Noise‐assisted hybrid attention networks for low‐dose PET and CT denoising

Convolutional neural networks for improving image quality with noisy PET data

Full-count PET Recovery from Low-count Image Using a Dilated Convolutional Neural Network

Cycle-Constrained Adversarial Denoising Convolutional Network for PET Image Denoising: Multi-Dimensional Validation on Large Datasets with Reader Study and Real Low-Dose Data

Rethinking PET Image Reconstruction: Ultra-Low-Dose, Sinogram and Deep Learning

POUR-Net: A Population-Prior-Aided Over-Under-Representation Network for Low-Count PET Attenuation Map Generation

Investigation of Lesion Detectability Using Deep Learning Based Denoising Methods in Oncology PET: a Cross-Center Phantom Study

An Adaptive Patch Sampling Scheme for Deep Learning Based PET Image Denoising