Abstract:Objective: Dynamic cone-beam computed tomography (CBCT) can capture high-spatial-resolution, time-varying images for motion monitoring, patient setup, and adaptive planning of radiotherapy. However, dynamic CBCT reconstruction is an extremely ill-posed spatiotemporal inverse problem, as each CBCT volume in the dynamic sequence is only captured by one or a few X-ray projections, due to the slow gantry rotation speed and the fast anatomical motion (e.g., breathing). Approach: We developed a machine learning-based technique, prior-model-free spatiotemporal implicit neural representation (PMF-STINR), to reconstruct dynamic CBCTs from sequentially acquired X-ray projections. PMF-STINR employs a joint image reconstruction and registration approach to address the under-sampling challenge, enabling dynamic CBCT reconstruction from singular X-ray projections. Specifically, PMF-STINR uses spatial implicit neural representations to reconstruct a reference CBCT volume, and it applies temporal INR to represent the intra-scan dynamic motion with respect to the reference CBCT to yield dynamic CBCTs. PMF-STINR couples the temporal INR with a learning-based B-spline motion model to capture time-varying deformable motion during the reconstruction. Compared with the previous methods, the spatial INR, the temporal INR, and the B-spline model of PMF-STINR are all learned on the fly during reconstruction in a one-shot fashion, without using any patient-specific prior knowledge or motion sorting/binning. Main results: PMF-STINR was evaluated via digital phantom simulations, physical phantom measurements, and a multi-institutional patient dataset featuring various imaging protocols (half-fan/full-fan, full sampling/sparse sampling, different energy and mAs settings, etc.). The results showed that the one-shot learning-based PMF-STINR can accurately and robustly reconstruct dynamic CBCTs and capture highly irregular motion with high temporal (~0.1s) resolution and sub-millimeter accuracy. Significance: PMF-STINR can reconstruct dynamic CBCTs and solve the intra-scan motion problem from conventional 3D CBCT scans without using any prior anatomical/motion model or motion sorting/binning. It can be a promising tool for motion management by offering richer motion information than traditional 4D-CBCTs.

Enhancing Dynamic CT Image Reconstruction with Neural Fields and Optical Flow

A Memory-Efficient Dynamic Image Reconstruction Method using Neural Fields

Neural Computed Tomography

Complex extension of optical flow and its practical evaluation for undersampled dynamic MRI

3D Tensor Based Nonlocal Low Rank Approximation in Dynamic PET Reconstruction.

Joint Reconstruction of Dynamic PET Activity and Kinetic Parametric Images Using Total Variation Constrained Dictionary Sparse Coding

Deep Network Cascade for Dynamic Cardiac MRI Reconstruction With Motion Feature Incorporation and the Fourier Neural Attention

Iterative reconstruction for limited-angle CT using implicit neural representation

Iterative CT Image Reconstruction Using Neural Network Optimization Algorithms

Neural rendering enables dynamic tomography

Spatiotemporal implicit neural representation for unsupervised dynamic MRI reconstruction

Neural Trajectory Fields for Dynamic Novel View Synthesis

ProxNF: Neural Field Proximal Training for High-Resolution 4D Dynamic Image Reconstruction

Optimal dynamic tomography for wide-sense stationary spatial random fields

Forward Flow for Novel View Synthesis of Dynamic Scenes

Dynamic Cone-beam CT Reconstruction using Spatial and Temporal Implicit Neural Representation Learning (STINR)

A Deep Cascade of Convolutional Neural Networks for Dynamic MR Image Reconstruction.

Spatiotemporal Image Reconstruction to Enable High-Frame Rate Dynamic Photoacoustic Tomography with Rotating-Gantry Volumetric Imagers

Dynamic Object-Based Tomographic Reconstruction

Dynamic CBCT imaging using prior model-free spatiotemporal implicit neural representation (PMF-STINR)

Real-Time Limited-View CT Inpainting and Reconstruction with Dual Domain Based on Spatial Information