Imaging of Chronic Concussion.

E. Bonfante,R. Riascos,O. Arevalo

DOI: https://doi.org/10.1016/j.nic.2017.09.011

IF: 2.624

2018-02-01

Neuroimaging Clinics of North America

Abstract:

What problem does this paper attempt to address?

Posterior Estimation Using Deep Learning: A Simulation Study of Compartmental Modeling in Dynamic PET

Xiaofeng Liu,Thibault Marin,Tiss Amal,Jonghye Woo,Georges El Fakhri,Jinsong Ouyang

DOI: https://doi.org/10.1002/mp.16078

2023-03-17

Abstract:Background: In medical imaging, images are usually treated as deterministic, while their uncertainties are largely underexplored. Purpose: This work aims at using deep learning to efficiently estimate posterior distributions of imaging parameters, which in turn can be used to derive the most probable parameters as well as their uncertainties. Methods: Our deep learning-based approaches are based on a variational Bayesian inference framework, which is implemented using two different deep neural networks based on conditional variational auto-encoder (CVAE), CVAE-dual-encoder and CVAE-dual-decoder. The conventional CVAE framework, i.e., CVAE-vanilla, can be regarded as a simplified case of these two neural networks. We applied these approaches to a simulation study of dynamic brain PET imaging using a reference region-based kinetic model. Results: In the simulation study, we estimated posterior distributions of PET kinetic parameters given a measurement of time-activity curve. Our proposed CVAE-dual-encoder and CVAE-dual-decoder yield results that are in good agreement with the asymptotically unbiased posterior distributions sampled by Markov Chain Monte Carlo (MCMC). The CVAE-vanilla can also be used for estimating posterior distributions, although it has an inferior performance to both CVAE-dual-encoder and CVAE-dual-decoder. Conclusions: We have evaluated the performance of our deep learning approaches for estimating posterior distributions in dynamic brain PET. Our deep learning approaches yield posterior distributions, which are in good agreement with unbiased distributions estimated by MCMC. All these neural networks have different characteristics and can be chosen by the user for specific applications. The proposed methods are general and can be adapted to other problems.

Image and Video Processing,Machine Learning,Medical Physics
Posterior Estimation for Dynamic PET imaging using Conditional Variational Inference

Xiaofeng Liu,Thibault Marin,Tiss Amal,Jonghye Woo,Georges El Fakhri,Jinsong Ouyang

2023-10-24

Abstract:This work aims efficiently estimating the posterior distribution of kinetic parameters for dynamic positron emission tomography (PET) imaging given a measurement of time of activity curve. Considering the inherent information loss from parametric imaging to measurement space with the forward kinetic model, the inverse mapping is ambiguous. The conventional (but expensive) solution can be the Markov Chain Monte Carlo (MCMC) sampling, which is known to produce unbiased asymptotical estimation. We propose a deep-learning-based framework for efficient posterior estimation. Specifically, we counteract the information loss in the forward process by introducing latent variables. Then, we use a conditional variational autoencoder (CVAE) and optimize its evidence lower bound. The well-trained decoder is able to infer the posterior with a given measurement and the sampled latent variables following a simple multivariate Gaussian distribution. We validate our CVAE-based method using unbiased MCMC as the reference for low-dimensional data (a single brain region) with the simplified reference tissue model.

Medical Physics,Artificial Intelligence,Signal Processing
[Fate of thyrotropin releasing hormone after binding to rat prolactin secreting cells (GH3 line). Evidence for releasing of unmodified [3H]-TRH (author'r transl)].

D. Gourdji,A. Tixier-vidal,H. Levine-Pinto,P. Pradelles,J. Morgat,P. Fromageot

Abstract:It was previously shown that after a 30 min. incubation with [3H]-TRH intact GH3 cells have already performed their optimal precocious biological response to TRH (i.e increase of prolactin release) and that chemically unmodified ( greater than or equal to 93%) [3H]-TRH entered the cells and remained associated to them. The present work demonstrates that such cells spontaneously release a radioactive material ([3H]RM) when post-incubated at 37 degrees C. The binding to GH3 cells (time course and competition with unlabelled TRH) as well as the biological effect on prolactin release and the electrophoretic mobility of the [3H]-RM released in one hour were compared to those of [3H]-TRH. According to those criteria [3H]-RM is undistinguishable from [3H]-TRH at 90%. Our data, therefore, support the hypothesis of a continuous flow of TRH molecules on both sides of the plasma membrane during TRH-GH3 cells interaction.
Noninvasive Estimation of Macro-Parameters by Deep Learning

Bo Wang,Dongsheng Ruan,Huafeng Liu

DOI: https://doi.org/10.1109/trpms.2020.2979017

2020-01-01

IEEE Transactions on Radiation and Plasma Medical Sciences

Abstract:The estimation of macro-parameters is a critical step in dynamic positron emission tomography (PET) analyses because these parameters can quantitatively characterize the physiologic state of the tracer in vivo . Numerous algorithms have been proposed to estimate macro-parameters. However, the implementation of these estimation algorithms requires accurate input functions which are difficult to obtain under noninvasive conditions. We developed a novel data-driven framework to estimate the macro-parameter noninvasively without input functions. We took the macro-parameters as a nonlinear function of the activity concentration of the tracer. Deep learning was used to determine this nonlinear function to obtain the macro-parameter directly from dynamic PET data. Our approach was divided into two phases: 1) training and 2) estimation. In the training phase, a deep neural network (DNN) learned the potential relationships between the dynamic PET data and the macro-parameters. In the estimation phase, the macro-parameter could be directly obtained when the dynamic PET data were inputted to the DNN. Experiments based on simulation datasets of 18 F-FDG and 11 C-FMZ and real datasets were conducted as validation. Our experimental results were compared with those by Patlak or Logan plot, which demonstrated the superior performance of the proposed approach in terms of robustness and accuracy.
Noninvasive Estimation of Macro-parameters for Dynamic PET Images Using Deep Learning

Bo Wang,Dongsheng Ruan,Huafeng Liu

DOI: https://doi.org/10.1109/nss/mic42101.2019.9059691

2019-01-01

Abstract:In dynamic positron emission tomography (PET), kinetic parameters can quantitatively show the state of the biochemical reaction of the tracer in the body. In general, the values of macro-parameters are more stable than those of micro-parameter, so they are valuable for clinical diagnosis. To estimate the macro-parameters, traditional methods require accurate plasma input functions which are usually obtained by arterial sampling. Unfortunately, collecting arterial blood is not only invasive to the patient, but also difficult to operate. In order to reduce the invasion to patients, we proposed a method to obtain the macro-parameters non-invasively. Deep learning techiques were adopted to learn the nonlinear relationship between the time activity curves (TACs) of tracer and macro-parameters. Our method consisted of two part: training and estimation. In the training part, the deep neural network (DNN) constantly adjusted its own weights to learn the potential functional relation between macro-parameters of interest and dynamic PET images. In the estimation part, desired parametric maps would be acquired directly as long as entering the dynamic PET data into the well-trained DNN. The experiment based on simulation dataset of [18F]-labeled fluorodeoxyglucose was conducted as validation. Our experimental results were compared with those obtained by Patlak plot, which demonstrated the superior performance of the proposed approach.
Joint Reconstruction of Dynamic PET Activity and Kinetic Parametric Images Using Total Variation Constrained Dictionary Sparse Coding

Haiqing Yu,Shuhang Chen,Yunmei Chen,Huafeng Liu

DOI: https://doi.org/10.1088/1361-6420/aa6165

IF: 2.408

2017-01-01

Inverse Problems

Abstract:Dynamic positron emission tomography (PET) is capable of providing both spatial and temporal information of radio tracers in vivo. In this paper, we present a novel joint estimation framework to reconstruct temporal sequences of dynamic PET images and the coefficients characterizing the system impulse response function, from which the associated parametric images of the system macro parameters for tracer kinetics can be estimated. The proposed algorithm, which combines statistical data measurement and tracer kinetic models, integrates a dictionary sparse coding (DSC) into a total variational minimization based algorithm for simultaneous reconstruction of the activity distribution and parametric map from measured emission sinograms. DSC, based on the compartmental theory, provides biologically meaningful regularization, and total variation regularization is incorporated to provide edge-preserving guidance. We rely on techniques from minimization algorithms (the alternating direction method of multipliers) to first generate the estimated activity distributions with sub-optimal kinetic parameter estimates, and then recover the parametric maps given these activity estimates. These coupled iterative steps are repeated as necessary until convergence. Experiments with synthetic, Monte Carlo generated data, and real patient data have been conducted, and the results are very promising.
Simultaneous Estimation and Segmentation from Projection Data in Dynamic PET.

Jianan Cui,Haiqing Yu,Shuhang Chen,Yunmei Chen,Huafeng Liu

DOI: https://doi.org/10.1002/mp.13364

IF: 4.506

2019-01-01

Medical Physics

Abstract:Purpose Dynamic positron emission tomography (PET) is known for its ability to extract spatiotemporal information of a radio tracer in living tissue. Information of different functional regions based on an accurate reconstruction of the activity images and kinetic parametric images has been widely studied and can be useful in research and clinical setting for diagnosis and other quantitative tasks. In this paper, our purpose is to present a novel framework for estimating the kinetic parametric images directly from the raw measurement data together with a simultaneous segmentation accomplished through kinetic parameters clustering. Method An iterative framework is proposed to estimate the kinetic parameter image, activity map and do the segmentation simultaneously from the complete dynamic PET projection data. The clustering process is applied to the kinetic parameter variable rather than to the traditional activity distribution so as to achieve accurate discrimination between different functional areas. Prior information such as total variation regularization is incorporated to reduce the noise in the PET images and a sparseness constraint is integrated to guarantee the solution for kinetic parameters due to the over complete dictionary. Alternating direction method of multipliers (ADMM) method is used to solve the optimization problem. The proposed algorithm was validated with experiments on Monte Carlo-simulated phantoms and real patient data. Symbol error rate (SER) was defined to evaluate the performance of clustering. Bias and variance of the reconstruction activity images were calculated based on ground truth. Relative mean square error (MSE) was used to evaluate parametric results quantitatively. Result In brain phantom experiment, when counting rate is 1 x 10(6), the bias (variance) of our method is 0.1270 (0.0281), which is lower than maximum likelihood expectation maximization (MLEM) 0.1637 (0.0410) and direct estimation without segmentation (DE) 0.1511 (0.0326). In the Zubal phantom experiment, our method has the lowest bias (variance) 0.1559 (0.0354) with 1 x 10(5) counting rate, compared with DE 0.1820 (0.0435) and MLEM 0.3043 (0.0644). As for classification, the SER of our method is 18.87% which is the lowest among MLEM + k-means, DE + k-means, and kinetic spectral clustering (KSC). Brain data with MR reference and real patient results also show that the proposed method can get images with clear structure by visual inspection. Conclusion In this paper, we presented a joint reconstruction framework for simultaneously estimating the activity distribution, parametric images, and parameter-based segmentation of the ROIs into different functional areas. Total variation regularization is performed on the activity distribution domain to suppress noise and preserve the edges between ROIs. An over complete dictionary for time activity curve basis is constructed. SER, bias, variance, and MSE were calculated to show the effectiveness of the proposed method. (c) 2018 American Association of Physicists in Medicine
CT-guided PET Parametric Image Reconstruction Using Deep Neural Network Without Prior Training Data

Jianan Cui,Kuang Gong,Ning Guo,Kyungsang Kim,Huafeng Liu,Quanzheng Li

DOI: https://doi.org/10.1117/12.2513077

2019-01-01

Abstract:Deep neural networks have attracted growing interests in medical image due to its success in computer vision tasks. One barrier for the application of deep neural networks is the need of large amounts of prior training pairs, which is not always feasible in clinical practice. Recently, the deep image prior framework shows that the convolutional neural network (CNN) can learn intrinsic structure information from the corrupted image. In this work, an iterative parametric reconstruction framework is proposed using deep neural network as constraint. The network does not need prior training pairs, but only the patient's own computed tomography (CT) image. The training is based on Logan plot derived from multi-bed-position dynamic positron emission tomography (PET) images using 68Ga-PRGD2 tracer. We formulated the estimation of the slope of Logan plot as a constraint optimization problem and solved it using the alternating direction method of multipliers (ADMM) algorithm. Quantification results based on real patient dataset shows that the proposed parametric reconstruction method is better than the Gaussian denoising and non-local mean denoising methods.
Estimating Uncertainty in PET Image Reconstruction via Deep Posterior Sampling

Tin Vlašić,Tomislav Matulić,Damir Seršić

2023-06-07

Abstract:Positron emission tomography (PET) is an important functional medical imaging technique often used in the evaluation of certain brain disorders, whose reconstruction problem is ill-posed. The vast majority of reconstruction methods in PET imaging, both iterative and deep learning, return a single estimate without quantifying the associated uncertainty. Due to ill-posedness and noise, a single solution can be misleading or inaccurate. Thus, providing a measure of uncertainty in PET image reconstruction can help medical practitioners in making critical decisions. This paper proposes a deep learning-based method for uncertainty quantification in PET image reconstruction via posterior sampling. The method is based on training a conditional generative adversarial network whose generator approximates sampling from the posterior in Bayesian inversion. The generator is conditioned on reconstruction from a low-dose PET scan obtained by a conventional reconstruction method and a high-quality magnetic resonance image and learned to estimate a corresponding standard-dose PET scan reconstruction. We show that the proposed model generates high-quality posterior samples and yields physically-meaningful uncertainty estimates.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
Deep Reconstruction Model For Dynamic Pet Images

Jianan Cui,Xin Liu,Yile Wang,Huafeng Liu

DOI: https://doi.org/10.1371/journal.pone.0184667

IF: 3.7

2017-01-01

PLoS ONE

Abstract:Accurate and robust tomographic reconstruction from dynamic positron emission tomography (PET) acquired data is a difficult problem. Conventional methods, such as the maximum likelihood expectation maximization (MLEM) algorithm for reconstructing the activity distribution-based on individual frames, may lead to inaccurate results due to the checkerboard effect and limitation of photon counts. In this paper, we propose a stacked sparse auto-encoder based reconstruction framework for dynamic PET imaging. The dynamic reconstruction problem is formulated in a deep learning representation, where the encoding layers extract the prototype features, such as edges, so that, in the decoding layers, the reconstructed results are obtained through a combination of those features. The qualitative and quantitative results of the procedure, including the data based on a Monte Carlo simulation and real patient data demonstrates the effectiveness of our method.
Unsupervised PET logan parametric image estimation using conditional deep image prior.

Jianan Cui,Kuang Gong,Ning Guo,Kyungsang Kim,Huafeng Liu,Quanzheng Li

DOI: https://doi.org/10.1016/j.media.2022.102519

IF: 10.9

2022-01-01

Medical Image Analysis

Abstract:Recently, deep learning-based denoising methods have been gradually used for PET images denoising and have shown great achievements. Among these methods, one interesting framework is conditional deep image prior (CDIP) which is an unsupervised method that does not need prior training or a large number of training pairs. In this work, we combined CDIP with Logan parametric image estimation to generate high-quality parametric images. In our method, the kinetic model is the Logan reference tissue model that can avoid arterial sampling. The neural network was utilized to represent the images of Logan slope and intercept. The patient's computed tomography (CT) image or magnetic resonance (MR) image was used as the network input to provide anatomical information. The optimization function was constructed and solved by the alternating direction method of multipliers (ADMM) algorithm. Both simulation and clinical patient datasets demonstrated that the proposed method could generate parametric images with more detailed structures. Quantification results showed that the proposed method results had higher contrast-to-noise (CNR) improvement ratios (PET/CT datasets: 62.25%±29.93%; striatum of brain PET datasets : 129.51%±32.13%, thalamus of brain PET datasets: 128.24%±31.18%) than Gaussian filtered results (PET/CT datasets: 23.33%±18.63%; striatum of brain PET datasets: 74.71%±8.71%, thalamus of brain PET datasets: 73.02%±9.34%) and nonlocal mean (NLM) denoised results (PET/CT datasets: 37.55%±26.56%; striatum of brain PET datasets: 100.89%±16.13%, thalamus of brain PET datasets: 103.59%±16.37%).
Dynamic Low-Count PET Image Reconstruction Using Spatio-Temporal Primal Dual Network.

Rui Hu,Jianan Cui,Chenxu Li,Chengjin Yu,Yunmei Chen,Huafeng Liu

DOI: https://doi.org/10.1088/1361-6560/acde3e

IF: 3.5

2023-01-01

Physics in Medicine and Biology

Abstract:Objective.Dynamic positron emission tomography (PET) imaging, which can provide information on dynamic changes in physiological metabolism, is now widely used in clinical diagnosis and cancer treatment. However, the reconstruction from dynamic data is extremely challenging due to the limited counts received in individual frame, especially in ultra short frames. Recently, the unrolled model-based deep learning methods have shown inspiring results for low-count PET image reconstruction with good interpretability. Nevertheless, the existing model-based deep learning methods mainly focus on the spatial correlations while ignore the temporal domain.Approach.In this paper, inspired by the learned primal dual (LPD) algorithm, we propose the spatio-temporal primal dual network (STPDnet) for dynamic low-count PET image reconstruction. Both spatial and temporal correlations are encoded by 3D convolution operators. The physical projection of PET is embedded in the iterative learning process of the network, which provides the physical constraints and enhances interpretability.Main results.The experiments of both simulation data and real rat scan data have shown that the proposed method can achieve substantial noise reduction in both temporal and spatial domains and outperform the maximum likelihood expectation maximization, spatio-temporal kernel method, LPD and FBPnet.Significance.Experimental results show STPDnet better reconstruction performance in the low count situation, which makes the proposed method particularly suitable in whole-body dynamic imaging and parametric PET imaging that require extreme short frames and usually suffer from high level of noise.
Improved Patlak Reconstruction from Low-dose Dynamic PET Using Temporal Non-local Neural Network

Nuobei Xie,Kuang Gong,Ning Guo,Quanzheng Li,Zhixing Qin,Zhifang Wu,Huafeng Liu

DOI: https://doi.org/10.1109/nss/mic42677.2020.9507974

2020-01-01

Abstract:Patlak model is constantly considered as a critical topic in the application of dynamic positron emission tomography (PET). Traditionally, direct reconstruction methods were preferred over indirect methods, for their complete noise modelling and comprehensive information exploited from raw data. Nevertheless, the development of direct methods was inevitably constrained by the scarcity for raw dynamic PET and the requirement for computation cost. In addition, the increasing demand for low-dose PET and the irresistible motion during the dynamic scan raise more challenges for the parametric imaging research. In this work, we proposed a deep learning based framework to compute full-dose direct Patlak reconstruction in high quality from low-dose dynamic reconstructions, with the motion correction incorporated in forward/backward projection. Moreover, a temporal non-local block was designed to complement the structural information for the reconstructed images. Results for multiple dynamic PET datasets are demonstrated in this work, compared with state-of-the-art supervised/unsupervised methods.
Simultaneous Reconstruction and Segmentation of Dynamic Pet Via Low-Rank and Sparse Matrix Decomposition

Shuhang Chen,Huafeng Liu,Zhenghui Hu,Heye Zhang,Pengcheng Shi,Yunmei Chen

DOI: https://doi.org/10.1109/tbme.2015.2404296

2015-01-01

Abstract:Although of great clinical value, accurate and robust reconstruction and segmentation of dynamic positron emission tomography (PET) images are great challenges due to low spatial resolution and high noise. In this paper, we propose a unified framework that exploits temporal correlations and variations within image sequences based on low-rank and sparse matrix decomposition. Thus, the two separate inverse problems, PET image reconstruction and segmentation, are accomplished in a simultaneous fashion. Considering low signal to noise ratio and piece-wise constant assumption of PET images, we also propose to regularize low-rank and sparse matrices with vectorial total variation norm. The resulting optimization problem is solved by augmented Lagrangian multiplier method with variable splitting. The effectiveness of proposed approach is validated on realistic Monte Carlo simulation datasets and the real patient data.
Full-Dose PET Image Estimation from Low-Dose PET Image Using Deep Learning: a Pilot Study

Sydney Kaplan,Yang-Ming Zhu

DOI: https://doi.org/10.1007/s10278-018-0150-3

IF: 4.903

2018-01-01

Journal of Digital Imaging

Abstract:Positron emission tomography (PET) imaging is an effective tool used in determining disease stage and lesion malignancy; however, radiation exposure to patients and technicians during PET scans continues to draw concern. One way to minimize radiation exposure is to reduce the dose of radioactive tracer administered in order to obtain the scan. Yet, low-dose images are inherently noisy and have poor image quality making them difficult to read. This paper proposes the use of a deep learning model that takes specific image features into account in the loss function to denoise low-dose PET image slices and estimate their full-dose image quality equivalent. Testing on low-dose image slices indicates a significant improvement in image quality that is comparable to the ground truth full-dose image slices. Additionally, this approach can lower the cost of conducting a PET scan since less radioactive material is required per scan, which may promote the usage of PET scans for medical diagnosis.
[Reporting of side-effects--a system in need of improvement. Reporting of a physician questionnaire].

Y. Ekbom,K. Hedenmalm,Li Dalin,K. Lönnroth,I. Persson

2002-08-22

Abstract:The spontaneous reporting system in Sweden is based on reporting by health care professionals of adverse drug reactions (ADRs) to the Medical Products Agency. The usefulness of the spontaneous reporting system is limited by a substantial degree of underreporting. In order to study factors that make reporting of ADRs difficult as well as to obtain responses to suggestions that could increase the reporting of ADRs, an enquiry was sent to 300 randomly selected physicians. The most important factors that make reporting of ADRs more difficult are lack of time and forgetfulness. Most physicians stated that they would report ADRs to a greater extent if reporting was simpler, if resources were available or if the response to the reporting was improved. The majority of the physicians who had a computer at work stated that they would like to access the reporting form electronically.
State-Space Reconstruction of Pet Parametric Maps

Huafeng Liu,Xiaona Jiang,Pengcheng Shi

DOI: https://doi.org/10.1109/ICIP.2006.312512

2006-01-01

ICIP

Abstract:The primary goal of dynamic positron emission tomography (PET) is to quantify the physiological and biological processes through tracer kinetics analysis. However, the process is difficult and complicated because of the compromising imaging data quality, i.e. either longer scans with good counting statistics but poor temporal resolution, or noisy shorter scans with good temporal resolution. In this paper, we explore the usage of state space principles for physiological parameter estimation in dynamic PET imaging. The system equation is constructed from particular tracer kinetic models, with the number and relationship between tissue compartments dictated by the physiological and biochemical properties of the process under study. And the observation equation on measurement data is formed based on the specific types of imaging or image-derived data. Once the Poisson distributed PET data are converted to Gaussian ones through the Anscombe transformation, an extended Kalman filter is adopted to estimate the tracer kinetics parameters from the system and observations. More appropriate estimation strategies which better take care of the PET statistics are also under development. The framework is tested on simulated digital phantom data, and the results are of sufficient accuracy and robustness.
Deep Dual-Domain Based Framework for PET Image Reconstruction

Xinrui Gao,Yunmei Chen,Rui Hu,Mengrui Chen,Huafeng Liu

DOI: https://doi.org/10.1117/12.3006448

2024-01-01

Abstract:Positron emission tomography (PET) is an advanced nuclear medicine imaging technique widely used in clinical diagnostics such as neurology and oncology. In PET image reconstruction, the widespread adoption of deep learning is attributed to its potent feature extraction capabilities. However, the challenge lies in ensuring that the employed network is interpretable and rational. Additionally, addressing the intricate issue of achieving superior results with a smaller training set remains a formidable task. In this paper, we propose a novel alternating learning dual-domain reconstruction algorithm. This method combines the likelihood function based on the PET imaging model with a learnable dual-domain regularization term as a composite objective. The objective function is minimized through alternating iterations to obtain reconstructed activity image and denoised sinogram. The iterative process enhances the convergence speed by integrating residual structures, and the assurance of result convergence is facilitated through the imposition of judgment conditions. Experimental results demonstrate that our method surpasses OSEM and DeepPET in terms of SSIM and PSNR.
Deep Learning reconstruction with uncertainty estimation for $γ$ photon interaction in fast scintillator detectors

Geoffrey Daniel,Mohamed Bahi Yahiaoui,Claude Comtat,Sebastien Jan,Olga Kochebina,Jean-Marc Martinez,Viktoriya Sergeyeva,Viatcheslav Sharyy,Chi-Hsun Sung,Dominique Yvon

DOI: https://doi.org/10.1016/j.engappai.2024.107876

2023-10-10

Abstract:This article presents a physics-informed deep learning method for the quantitative estimation of the spatial coordinates of gamma interactions within a monolithic scintillator, with a focus on Positron Emission Tomography (PET) imaging. A Density Neural Network approach is designed to estimate the 2-dimensional gamma photon interaction coordinates in a fast lead tungstate (PbWO4) monolithic scintillator detector. We introduce a custom loss function to estimate the inherent uncertainties associated with the reconstruction process and to incorporate the physical constraints of the detector. This unique combination allows for more robust and reliable position estimations and the obtained results demonstrate the effectiveness of the proposed approach and highlights the significant benefits of the uncertainties estimation. We discuss its potential impact on improving PET imaging quality and show how the results can be used to improve the exploitation of the model, to bring benefits to the application and how to evaluate the validity of the given prediction and the associated uncertainties. Importantly, our proposed methodology extends beyond this specific use case, as it can be generalized to other applications beyond PET imaging.

Instrumentation and Detectors,Machine Learning,Medical Physics
Physics-driven Deep Learning for PET/MRI

Abhejit Rajagopal,Andrew P. Leynes,Nicholas Dwork,Jessica E. Scholey,Thomas A. Hope,Peder E. Z. Larson

DOI: https://doi.org/10.48550/arXiv.2206.06788

2022-06-11

Image and Video Processing

Abstract:In this paper, we review physics- and data-driven reconstruction techniques for simultaneous positron emission tomography (PET) / magnetic resonance imaging (MRI) systems, which have significant advantages for clinical imaging of cancer, neurological disorders, and heart disease. These reconstruction approaches utilize priors, either structural or statistical, together with a physics-based description of the PET system response. However, due to the nested representation of the forward problem, direct PET/MRI reconstruction is a nonlinear problem. We elucidate how a multi-faceted approach accommodates hybrid data- and physics-driven machine learning for reconstruction of 3D PET/MRI, summarizing important deep learning developments made in the last 5 years to address attenuation correction, scattering, low photon counts, and data consistency. We also describe how applications of these multi-modality approaches extend beyond PET/MRI to improving accuracy in radiation therapy planning. We conclude by discussing opportunities for extending the current state-of-the-art following the latest trends in physics- and deep learning-based computational imaging and next-generation detector hardware.

Imaging of Chronic Concussion.

Posterior Estimation Using Deep Learning: A Simulation Study of Compartmental Modeling in Dynamic PET

Posterior Estimation for Dynamic PET imaging using Conditional Variational Inference

[Fate of thyrotropin releasing hormone after binding to rat prolactin secreting cells (GH3 line). Evidence for releasing of unmodified [3H]-TRH (author'r transl)].

Noninvasive Estimation of Macro-Parameters by Deep Learning

Noninvasive Estimation of Macro-parameters for Dynamic PET Images Using Deep Learning

Joint Reconstruction of Dynamic PET Activity and Kinetic Parametric Images Using Total Variation Constrained Dictionary Sparse Coding

Simultaneous Estimation and Segmentation from Projection Data in Dynamic PET.

CT-guided PET Parametric Image Reconstruction Using Deep Neural Network Without Prior Training Data

Estimating Uncertainty in PET Image Reconstruction via Deep Posterior Sampling

Deep Reconstruction Model For Dynamic Pet Images

Unsupervised PET logan parametric image estimation using conditional deep image prior.

Dynamic Low-Count PET Image Reconstruction Using Spatio-Temporal Primal Dual Network.

Improved Patlak Reconstruction from Low-dose Dynamic PET Using Temporal Non-local Neural Network

Simultaneous Reconstruction and Segmentation of Dynamic Pet Via Low-Rank and Sparse Matrix Decomposition

Full-Dose PET Image Estimation from Low-Dose PET Image Using Deep Learning: a Pilot Study

[Reporting of side-effects--a system in need of improvement. Reporting of a physician questionnaire].

State-Space Reconstruction of Pet Parametric Maps

Deep Dual-Domain Based Framework for PET Image Reconstruction

Deep Learning reconstruction with uncertainty estimation for $γ$ photon interaction in fast scintillator detectors

Physics-driven Deep Learning for PET/MRI