Abstract:Background and objective: Neural network based image reconstruction methods are becoming increasingly popular. However, limited training data and the lack of theoretical guarantees for generalizability raised concerns, especially in biomedical imaging applications. These challenges are known to lead to an unstable reconstruction process that poses significant problems in biomedical image reconstruction. In this paper, we present a new framework that uses untrained generator networks to tackle this challenge, leveraging the structure of deep networks for regularizing solutions based on a technique known as Deep Image Prior (DIP).Methods: To achieve a high reconstruction accuracy, we propose a framework optimizing both the latent vector and the weights of a generator network during the reconstruction process. We also propose the corresponding reconstruction strategies to improve the stability and convergent performance of the proposed framework. Furthermore, instead of calculating forward projection in each iteration, we propose implementing its normal operator as a convolutional kernel under parallel beam geometry, thus greatly accelerating the calculation.Results: Our experiments show that the proposed framework has significant improvements over other state-of-the-art conventional, pre-trained, and untrained methods under sparse-view, limited-angle, and low-dose conditions.Conclusions: Applying to parallel beam X-ray imaging, our framework shows advantages in speed, accuracy, and stability of the reconstruction process. We also show that the proposed framework is compatible with all differentiable regularizations that are commonly used in biomedical image reconstruction literature. Our framework can also be used as a post-processing technique to further improve the reconstruction generated by any other reconstruction methods. Furthermore, the proposed framework requires no training data and can be adjusted on-demand to adapt to different conditions (e.g. noise level, geometry, and imaged object).

A geometry-informed deep learning framework for ultra-sparse 3D tomographic image reconstruction

Deep Learning for Under-Sampled Non-Cartesian ASL MRI Reconstruction

Universal and High-Fidelity Resolution Extending for Fluorescence Microscopy Using a Single-Training Physics-Informed Sparse Neural Network

Deep learning for tomographic image reconstruction

Geometry-Aware Attenuation Learning for Sparse-View CBCT Reconstruction

Deep Optimized Priors for 3D Shape Modeling and Reconstruction

Deep Radon Prior: A Fully Unsupervised Framework for Sparse-View CT Reconstruction

A dual-domain deep learning-based reconstruction method for fully 3D sparse data helical CT

TomoGRAF: A Robust and Generalizable Reconstruction Network for Single-View Computed Tomography

Linear diffusion noise boosted deep image prior for unsupervised sparse-view CT reconstruction

Combining Deep Learning and Adaptive Sparse Modeling for Low-dose CT Reconstruction

3D Helical CT Reconstruction With a Memory Efficient Learned Primal-Dual Architecture

Prior information-based high-resolution tomography image reconstruction from a single digitally reconstructed radiograph

Integrating Deep Unfolding with Direct Diffusion Bridges for Computed Tomography Reconstruction

Sparse-view and limited-angle CT reconstruction with untrained networks and deep image prior

MVMS-RCN: A Dual-Domain Unfolding CT Reconstruction with Multi-sparse-view and Multi-scale Refinement-correction

A Perspective on Deep Imaging

Deep Learning in Photoacoustic Tomography: Current approaches and future directions

A Self-Supervised Approach to Reconstruction in Sparse X-Ray Computed Tomography

Terahertz Spatio-Temporal Deep Learning Computed Tomography

Enhancing Low-dose CT Image Reconstruction by Integrating Supervised and Unsupervised Learning