Abstract:Abstract In this paper we present a generalized Deep Learning-based approach for solving ill-posed large-scale inverse problems occuring in medical image reconstruction. Recently, Deep Learning methods using iterative neural networks (NNs) and cascaded NNs have been reported to achieve state-of-the-art results with respect to various quantitative quality measures as PSNR, NRMSE and SSIM across different imaging modalities. However, the fact that these approaches employ the application of the forward and adjoint operators repeatedly in the network architecture requires the network to process the whole images or volumes at once, which for some applications is computationally infeasible. In this work, we follow a different reconstruction strategy by strictly separating the application of the NN, the regularization of the solution and the consistency with the measured data. The regularization is given in the form of an image prior obtained by the output of a previously trained NN which is used in a Tikhonov regularization framework. By doing so, more complex and sophisticated network architectures can be used for the removal of the artefacts or noise than it is usually the case in iterative NNs. Due to the large scale of the considered problems and the resulting computational complexity of the employed networks, the priors are obtained by processing the images or volumes as patches or slices. We evaluated the method for the cases of 3D cone-beam low dose CT and undersampled 2D radial cine MRI and compared it to a total variation-minimization-based reconstruction algorithm as well as to a method with regularization based on learned overcomplete dictionaries. The proposed method outperformed all the reported methods with respect to all chosen quantitative measures and further accelerates the regularization step in the reconstruction by several orders of magnitude.

Error Estimates for Data-driven Weakly Convex Frame-based Image Regularization

Statistical Image Reconstruction for Low-Dose Ct Using Nonlocal Means-Based Regularization

Convergence of non-linear diagonal frame filtering for regularizing inverse problems

Convergent Data-Driven Regularizations for CT Reconstruction

Learning Weakly Convex Regularizers for Convergent Image-Reconstruction Algorithms

Data Driven Tight Frame for Compressed Sensing MRI Reconstruction Via Off-the-Grid Regularization

Structurally Adaptive Multi-Derivative Regularization for Image Recovery from Sparse Fourier Samples

Two Stage Continuous Domain Regularization for Piecewise Constant Image Restoration

Learned convex regularizers for inverse problems

CT Image Reconstruction by Spatial-Radon Domain Data-Driven Tight Frame Regularization

Stability of Data-Dependent Ridge-Regularization for Inverse Problems

Data-Driven Multi-scale Non-local Wavelet Frame Construction and Image Recovery

Shearlet-based regularization in statistical inverse learning with an application to X-ray tomography

A CT Reconstruction Method Based on Constrained Data Fidelity Range Estimation

Edge-preserving Reconstruction with Contour-Line Smoothing and Non-Quadratic Data-Fidelity

Neural networks-based regularization for large-scale medical image reconstruction

Convex Latent-Optimized Adversarial Regularizers for Imaging Inverse Problems

Data-driven Morozov regularization of inverse problems