Abstract:Objective: Dynamic cone-beam computed tomography (CBCT) can capture high-spatial-resolution, time-varying images for motion monitoring, patient setup, and adaptive planning of radiotherapy. However, dynamic CBCT reconstruction is an extremely ill-posed spatiotemporal inverse problem, as each CBCT volume in the dynamic sequence is only captured by one or a few X-ray projections, due to the slow gantry rotation speed and the fast anatomical motion (e.g., breathing). Approach: We developed a machine learning-based technique, prior-model-free spatiotemporal implicit neural representation (PMF-STINR), to reconstruct dynamic CBCTs from sequentially acquired X-ray projections. PMF-STINR employs a joint image reconstruction and registration approach to address the under-sampling challenge, enabling dynamic CBCT reconstruction from singular X-ray projections. Specifically, PMF-STINR uses spatial implicit neural representations to reconstruct a reference CBCT volume, and it applies temporal INR to represent the intra-scan dynamic motion with respect to the reference CBCT to yield dynamic CBCTs. PMF-STINR couples the temporal INR with a learning-based B-spline motion model to capture time-varying deformable motion during the reconstruction. Compared with the previous methods, the spatial INR, the temporal INR, and the B-spline model of PMF-STINR are all learned on the fly during reconstruction in a one-shot fashion, without using any patient-specific prior knowledge or motion sorting/binning. Main results: PMF-STINR was evaluated via digital phantom simulations, physical phantom measurements, and a multi-institutional patient dataset featuring various imaging protocols (half-fan/full-fan, full sampling/sparse sampling, different energy and mAs settings, etc.). The results showed that the one-shot learning-based PMF-STINR can accurately and robustly reconstruct dynamic CBCTs and capture highly irregular motion with high temporal (~0.1s) resolution and sub-millimeter accuracy. Significance: PMF-STINR can reconstruct dynamic CBCTs and solve the intra-scan motion problem from conventional 3D CBCT scans without using any prior anatomical/motion model or motion sorting/binning. It can be a promising tool for motion management by offering richer motion information than traditional 4D-CBCTs.

Dynamic Image Reconstruction to Monitor Tumor Vascular Perfusion in Small Animals Using 3D Photoacoustic Computed-Tomography Imagers with Rotating Gantries

Spatiotemporal image reconstruction to enable high-frame-rate dynamic photoacoustic tomography with rotating-gantry volumetric imagers

Rapid 3D Dynamic Arterial Spin Labeling with a Sparse Model-Based Image Reconstruction

Spatiotemporal Image Reconstruction to Enable High-Frame Rate Dynamic Photoacoustic Tomography with Rotating-Gantry Volumetric Imagers

Endoscopic Optical Coherence Tomography Angiography Using Inverse SNR-amplitude Decorrelation Features and Electrothermal Micro-Electro-mechanical System Raster Scan

Functional Imaging of Cerebrovascular Activities in Small Animals Using High-Resolution Photoacoustic Tomography.

Dynamic Reconstruction of Three-Dimensional Photoacoustic Tomography from Few Projections

Fast Spatiotemporal Image Reconstruction Based on Low-Rank Matrix Estimation for Dynamic Photoacoustic Computed Tomography

Single-Impulse Panoramic Photoacoustic Computed Tomography of Small-Animal Whole-Body Dynamics at High Spatiotemporal Resolution

High-speed three-dimensional photoacoustic computed tomography for preclinical research and clinical translation

3D Multiparametric Photoacoustic Computed Tomography of Primary and Metastatic Tumors in Living Mice

Dynamic PET cardiac and parametric image reconstruction: a fixed-point proximity gradient approach using patch-based DCT and tensor SVD regularization

Anatomical and Metabolic Small-Animal Whole-Body Imaging Using Ring-Shaped Confocal Photoacoustic Computed Tomography

A Constrained Variable Projection Reconstruction Method for Photoacoustic Computed Tomography Without Accurate Knowledge of Transducer Responses

Small-Animal Whole-Body Imaging Using A Photoacoustic Full-Ring Array System

Accelerated High-Resolution Photoacoustic Tomography via Compressed Sensing

Dynamic CBCT imaging using prior model-free spatiotemporal implicit neural representation (PMF-STINR)

Real-time volumetric imaging of cells and molecules in deep tissues with Takoyaki ultrasound

Snapshot photoacoustic topography through an ergodic relay of optical absorption in vivo

Self-Guided Algorithm for Fast Image Reconstruction in Photo-Magnetic Imaging: Artificial Intelligence-Assisted Approach

Single-shot 3D photoacoustic computed tomography with a densely packed array for transcranial functional imaging