Abstract:Dynamic three-dimensional (4D) reconstruction from two-dimensional X-ray coronary angiography (CA) remains a significant clinical problem. Challenges include sparse-view settings, intra-scan motion, and complex vessel morphology such as structure sparsity and background occlusion. Existing CA reconstruction methods often require extensive user interaction or large training datasets. On the other hand, Neural Radiance Field (NeRF), a promising deep learning technique, has successfully reconstructed high-fidelity static scenes for natural and medical scenes. Recent work, however, identified that sparse-views, background occlusion, and dynamics still pose a challenge when applying NeRF in the X-ray angiography context. Meanwhile, many successful works for natural scenes propose regularization for sparse-view reconstruction or scene decomposition to handle dynamics. However, these techniques do not directly translate to the CA context, where both challenges and background occlusion are significant. This paper introduces NeRF-CA, the first step toward a 4D CA reconstruction method that achieves reconstructions from sparse coronary angiograms with cardiac motion. We leverage the motion of the coronary artery to decouple the scene into a dynamic coronary artery component and static background. We combine this scene decomposition with tailored regularization techniques. These techniques enforce the separation of the coronary artery from the background by enforcing dynamic structure sparsity and scene smoothness. By uniquely combining these approaches, we achieve 4D reconstructions from as few as four angiogram sequences. This setting aligns with clinical workflows while outperforming state-of-the-art X-ray sparse-view NeRF reconstruction techniques. We validate our approach quantitatively and qualitatively using 4D phantom datasets and ablation studies.

ProxNF: Neural Field Proximal Training for High-Resolution 4D Dynamic Image Reconstruction

ProxNF: Neural Field Proximal Training for High-Resolution 4D Dynamic Image Reconstruction

The Integration of Neural Network and Physical Reconstruction Model for Fourier Ptychographic Microscopy

Universal and High-Fidelity Resolution Extending for Fluorescence Microscopy Using a Single-Training Physics-Informed Sparse Neural Network

A Memory-Efficient Dynamic Image Reconstruction Method using Neural Fields

Non-line-of-Sight Imaging via Neural Transient Fields

DNF: Diffractive Neural Field for Lensless Microscopic Imaging

TomoGRAF: A Robust and Generalizable Reconstruction Network for Single-View Computed Tomography

Neural Fields for Adaptive Photoacoustic Computed Tomography

Domain Transform Network for Photoacoustic Tomography from Limited-view and Sparsely Sampled Data

Local Conditional Neural Fields for Versatile and Generalizable Large-Scale Reconstructions in Computational Imaging

Physics to the Rescue: Deep Non-line-of-sight Reconstruction for High-speed Imaging

High-fidelity Endoscopic Image Synthesis by Utilizing Depth-guided Neural Surfaces

PA-NeRF, a neural radiance field model for 3D photoacoustic tomography reconstruction from limited Bscan data

Residual Back Projection With Untrained Neural Networks

NeRF-CA: Dynamic Reconstruction of X-ray Coronary Angiography with Extremely Sparse-views

Efficient Neural Reconstruction for Freehand 3-D Ultrasound Imaging and Visualization in Augmented Reality

Endo-4DGS: Endoscopic Monocular Scene Reconstruction with 4D Gaussian Splatting

The Adaption of Recent New Concepts in Neural Radiance Fields and Their Role for High-Fidelity Volume Reconstruction in Medical Images

PgNN: Physics-guided Neural Network for Fourier Ptychographic Microscopy

$ρ$-NeRF: Leveraging Attenuation Priors in Neural Radiance Field for 3D Computed Tomography Reconstruction