Abstract:Background and objective: Neural network based image reconstruction methods are becoming increasingly popular. However, limited training data and the lack of theoretical guarantees for generalizability raised concerns, especially in biomedical imaging applications. These challenges are known to lead to an unstable reconstruction process that poses significant problems in biomedical image reconstruction. In this paper, we present a new framework that uses untrained generator networks to tackle this challenge, leveraging the structure of deep networks for regularizing solutions based on a technique known as Deep Image Prior (DIP).Methods: To achieve a high reconstruction accuracy, we propose a framework optimizing both the latent vector and the weights of a generator network during the reconstruction process. We also propose the corresponding reconstruction strategies to improve the stability and convergent performance of the proposed framework. Furthermore, instead of calculating forward projection in each iteration, we propose implementing its normal operator as a convolutional kernel under parallel beam geometry, thus greatly accelerating the calculation.Results: Our experiments show that the proposed framework has significant improvements over other state-of-the-art conventional, pre-trained, and untrained methods under sparse-view, limited-angle, and low-dose conditions.Conclusions: Applying to parallel beam X-ray imaging, our framework shows advantages in speed, accuracy, and stability of the reconstruction process. We also show that the proposed framework is compatible with all differentiable regularizations that are commonly used in biomedical image reconstruction literature. Our framework can also be used as a post-processing technique to further improve the reconstruction generated by any other reconstruction methods. Furthermore, the proposed framework requires no training data and can be adjusted on-demand to adapt to different conditions (e.g. noise level, geometry, and imaged object).

Enhancing Low-dose CT Image Reconstruction by Integrating Supervised and Unsupervised Learning

Combining Deep Learning and Adaptive Sparse Modeling for Low-dose CT Reconstruction

SUPER Learning: A Supervised-Unsupervised Framework for Low-Dose CT Image Reconstruction

A Model-Based Unsupervised Deep Learning Method for Low-Dose CT Reconstruction

A Self-supervised Deep Learning Network for Low-Dose CT Reconstruction

Proj2Proj: self-supervised low-dose CT reconstruction

Deep Learning with Adaptive Hyper-Parameters for Low-Dose CT Image Reconstruction.

Low-Dose CT Reconstruction Using Dataset-free Learning

Low Dose CT Image Reconstruction Using Deep Convolutional Residual Learning Network

Sparse-view and limited-angle CT reconstruction with untrained networks and deep image prior

Low-dose CT image reconstruction based on a deep neural network

Self-Supervised Training For Low Dose CT Reconstruction

Noise-Generating and Imaging Mechanism Inspired Implicit Regularization Learning Network for Low Dose CT Reconstrution.

Hybrid plug-and-play CT image restoration using nonconvex low-rank group sparsity and deep denoiser priors

Re-UNet: A Novel Multi-scale Reverse U-shaped Network Architecture for Low-dose CT Image Reconstruction

Can Deep Learning Outperform Modern Commercial CT Image Reconstruction Methods?

A Model-based Deep Learning Reconstruction for X-ray CT

Linear diffusion noise boosted deep image prior for unsupervised sparse-view CT reconstruction

LdCT-Net: Low-Dose CT Image Reconstruction Strategy Driven by a Deep Dual Network

A Deep Learning Reconstruction Method for Sparsely Spaced Multidetector Helical CT Using Cascaded Dual-Domain CNN

Low-Dose CT Reconstruction via Dual-Domain Learning and Controllable Modulation