Abstract:Objective: Dynamic cone-beam computed tomography (CBCT) can capture high-spatial-resolution, time-varying images for motion monitoring, patient setup, and adaptive planning of radiotherapy. However, dynamic CBCT reconstruction is an extremely ill-posed spatiotemporal inverse problem, as each CBCT volume in the dynamic sequence is only captured by one or a few X-ray projections, due to the slow gantry rotation speed and the fast anatomical motion (e.g., breathing). Approach: We developed a machine learning-based technique, prior-model-free spatiotemporal implicit neural representation (PMF-STINR), to reconstruct dynamic CBCTs from sequentially acquired X-ray projections. PMF-STINR employs a joint image reconstruction and registration approach to address the under-sampling challenge, enabling dynamic CBCT reconstruction from singular X-ray projections. Specifically, PMF-STINR uses spatial implicit neural representations to reconstruct a reference CBCT volume, and it applies temporal INR to represent the intra-scan dynamic motion with respect to the reference CBCT to yield dynamic CBCTs. PMF-STINR couples the temporal INR with a learning-based B-spline motion model to capture time-varying deformable motion during the reconstruction. Compared with the previous methods, the spatial INR, the temporal INR, and the B-spline model of PMF-STINR are all learned on the fly during reconstruction in a one-shot fashion, without using any patient-specific prior knowledge or motion sorting/binning. Main results: PMF-STINR was evaluated via digital phantom simulations, physical phantom measurements, and a multi-institutional patient dataset featuring various imaging protocols (half-fan/full-fan, full sampling/sparse sampling, different energy and mAs settings, etc.). The results showed that the one-shot learning-based PMF-STINR can accurately and robustly reconstruct dynamic CBCTs and capture highly irregular motion with high temporal (~0.1s) resolution and sub-millimeter accuracy. Significance: PMF-STINR can reconstruct dynamic CBCTs and solve the intra-scan motion problem from conventional 3D CBCT scans without using any prior anatomical/motion model or motion sorting/binning. It can be a promising tool for motion management by offering richer motion information than traditional 4D-CBCTs.

Spatiotemporal image reconstruction to enable high-frame-rate dynamic photoacoustic tomography with rotating-gantry volumetric imagers

Spatiotemporal Image Reconstruction to Enable High-Frame Rate Dynamic Photoacoustic Tomography with Rotating-Gantry Volumetric Imagers

Dynamic Image Reconstruction to Monitor Tumor Vascular Perfusion in Small Animals Using 3D Photoacoustic Computed-Tomography Imagers with Rotating Gantries

Rapid 3D Dynamic Arterial Spin Labeling with a Sparse Model-Based Image Reconstruction

Fast Spatiotemporal Image Reconstruction Based on Low-Rank Matrix Estimation for Dynamic Photoacoustic Computed Tomography

Dynamic Reconstruction of Three-Dimensional Photoacoustic Tomography from Few Projections

Technical Note: Sequential Combination of Parallel Imaging and Dynamic Artificial Sparsity Framework for Rapid Free‐breathing Golden‐angle Radial Dynamic MRI: K‐T ARTS‐GROWL

High-speed, sparse-sampling three-dimensional photoacoustic computed tomography in vivo based on principal component analysis.

Dynamic CBCT imaging using prior model-free spatiotemporal implicit neural representation (PMF-STINR)

Accelerated High-Resolution Photoacoustic Tomography via Compressed Sensing

A Constrained Variable Projection Reconstruction Method for Photoacoustic Computed Tomography Without Accurate Knowledge of Transducer Responses

High-speed three-dimensional photoacoustic computed tomography for preclinical research and clinical translation

Dynamic Cone-beam CT Reconstruction using Spatial and Temporal Implicit Neural Representation Learning (STINR)

Dynamic PET cardiac and parametric image reconstruction: a fixed-point proximity gradient approach using patch-based DCT and tensor SVD regularization

4D Cone Beam CT Via Spatiotemporal Tensor Framelet.

Comprehensive framework of GPU-accelerated image reconstruction for photoacoustic computed tomography

Accelerated Reconstruction of Perfusion-Weighted MRI Enforcing Jointly Local and Nonlocal Spatio-temporal Constraints

Fast and Robust Deconvolution-Based Image Reconstruction for Photoacoustic Tomography in Circular Geometry: Experimental Validation

Extreme MRI: Large-Scale Volumetric Dynamic Imaging from Continuous Non-Gated Acquisitions

Fast Stimulated Raman Projection Tomography with Iterative Reconstruction from Sparse Projections