Abstract:Background and objective: Neural network based image reconstruction methods are becoming increasingly popular. However, limited training data and the lack of theoretical guarantees for generalizability raised concerns, especially in biomedical imaging applications. These challenges are known to lead to an unstable reconstruction process that poses significant problems in biomedical image reconstruction. In this paper, we present a new framework that uses untrained generator networks to tackle this challenge, leveraging the structure of deep networks for regularizing solutions based on a technique known as Deep Image Prior (DIP).Methods: To achieve a high reconstruction accuracy, we propose a framework optimizing both the latent vector and the weights of a generator network during the reconstruction process. We also propose the corresponding reconstruction strategies to improve the stability and convergent performance of the proposed framework. Furthermore, instead of calculating forward projection in each iteration, we propose implementing its normal operator as a convolutional kernel under parallel beam geometry, thus greatly accelerating the calculation.Results: Our experiments show that the proposed framework has significant improvements over other state-of-the-art conventional, pre-trained, and untrained methods under sparse-view, limited-angle, and low-dose conditions.Conclusions: Applying to parallel beam X-ray imaging, our framework shows advantages in speed, accuracy, and stability of the reconstruction process. We also show that the proposed framework is compatible with all differentiable regularizations that are commonly used in biomedical image reconstruction literature. Our framework can also be used as a post-processing technique to further improve the reconstruction generated by any other reconstruction methods. Furthermore, the proposed framework requires no training data and can be adjusted on-demand to adapt to different conditions (e.g. noise level, geometry, and imaged object).

Subspace Model-Assisted Deep Learning for Improved Image Reconstruction.

Deep Learning for Under-Sampled Non-Cartesian ASL MRI Reconstruction

Model-based Reconstruction with Learning: From Unsupervised to Supervised and Beyond

Deep plug-and-play MRI reconstruction based on multiple complementary priors

Enhancing Low-dose CT Image Reconstruction by Integrating Supervised and Unsupervised Learning

Combining Deep Learning and Adaptive Sparse Modeling for Low-dose CT Reconstruction

Data-Consistent Non-Cartesian Deep Subspace Learning for Efficient Dynamic MR Image Reconstruction

Undersampled Magnetic Resonance Image Reconstruction Based on Support Prior and Deep Image Prior Without Pre-Training

Image Reconstruction via Deep Image Prior Subspaces

Model-based Deep Medical Imaging: the roadmap of generalizing iterative reconstruction model using deep learning

Sparse-view and limited-angle CT reconstruction with untrained networks and deep image prior

Deep Learning-Based Image Reconstruction for Different Medical Imaging Modalities

Image Reconstruction: From Sparsity to Data-adaptive Methods and Machine Learning

Deep Magnetic Resonance Image Reconstruction: Inverse Problems Meet Neural Networks

Integrating Subspace Learning, Manifold Learning, and Sparsity Learning to Reconstruct Image Sequences

Two-layer Residual Sparsifying Transform Learning for Image Reconstruction

High-dimensional embedding network derived prior for compressive sensing MRI reconstruction

A geometry-informed deep learning framework for ultra-sparse 3D tomographic image reconstruction

A survey on deep learning in medical image reconstruction

High-Dimensional MR Reconstruction Integrating Subspace and Adaptive Generative Models

Deep Learning-Guided Image Reconstruction from Incomplete Data