Abstract:State-of-the-art MR-PET scanners allow simultaneous data acquisition. However, image reconstruction is performed separately and results are only combined at the visualization stage. PET images are reconstructed using a variant of EM and MR data are reconstructed using an inverse Fourier transform or iterative algorithms for parallel imaging or compressed sensing. We propose a new iterative joint reconstruction framework based on multi-sensor compressed sensing that exploits anatomical correlations between MR and PET. Joint reconstruction is motivated by the fact that MR and PET are based on the same anatomy. High resolution MR information can be used to enhance the PET reconstruction and MR artifacts are not present in the PET image. Therefore a dedicated reconstruction can exploit the incoherence of artifacts in the joint space. Our approach uses a nonlinear constrained optimization problem. In each iteration OSEM enforces data consistency of the current solution with measured PET rawdata. An l1-norm based joint sparsity term exploits anatomical correlations. MR data consistency is enforced with the MR forward operator, consisting of coil sensitivity modulation and a (non-uniform) Fourier transform. Data were acquired on a clinical 3T MR-PET unit (Siemens Biograph mMR). 10 mCi 18F-FDG were injected followed by a 60min list mode scan. 3D MP-RAGE was used for MR data acquisition: TR=2300ms, TE=2.98ms, TI=900ms, FA=9°, acceleration factor 2, 24 ACS lines, 256 matrix, voxel size=1×1×1mm3, 192 slices. Joint MR-PET reconstruction improves resolution in PET images when structures are aligned with MR. PET signal information cannot be improved in regions showing no distinctive MR contrast, but it is also not influenced falsely. The availability of simultaneously-acquired MR and PET data will also enable incorporation of dynamic correlations and motion correction into the joint reconstruction framework. We expect that this provides additional enhancements to the information content of multimodality studies.

PET-MRI Joint Reconstruction with Common Edge Weighted Total Variation Regularization

Joint Reconstruction of Dynamic PET Activity and Kinetic Parametric Images Using Total Variation Constrained Dictionary Sparse Coding

Low dose PET reconstruction with total variation regularization.

Simultaneous Reconstruction and Segmentation of Dynamic Pet Via Low-Rank and Sparse Matrix Decomposition

Nonlocal Total Variation Based Dynamic PET Image Reconstruction with Low-Rank Constraints

PET-MRI Joint Reconstruction by Joint Sparsity Based Tight Frame Regularization

Edge-Guided Dual-Modality Image Reconstruction.

Joint PET-MRI Reconstruction with Diffusion Stochastic Differential Model

Deep-learning Based Joint Estimation of Dual-Tracer PET Image Activity Maps and Clustering of Time Activity Curves

Nonlocal Low-Rank and Total Variation Constrained PET Image Reconstruction

3D Tensor Based Nonlocal Low Rank Approximation in Dynamic PET Reconstruction.

Patch-based Image Reconstruction for PET Using Prior-Image Derived Dictionaries

Deep Dual-Domain Based Framework for PET Image Reconstruction

Joint Reconstruction of Simultaneously Acquired MR-PET Data with Multi Sensor Compressed Sensing Based on a Joint Sparsity Constraint.

Bimodal PET/MRI generative reconstruction based on VAE architectures

Deep Reconstruction Model For Dynamic Pet Images

Joint Diffusion: Mutual Consistency-Driven Diffusion Model for PET-MRI Co-Reconstruction

Low Dose PET Image Reconstruction with Total Variation Using Alternating Direction Method.

Uncertainty Penalized Weighted Least Squares Framework For Pet Reconstruction Under Uncertain System Models

PET-MR Joint Reconstruction with Information Theoretic Priors

Joint Edge Optimization Deep Unfolding Network for Accelerated MRI Reconstruction