Abstract:Image reconstruction from limited and/or sparse data is known to be an ill-posed problem and a priori information/constraints have played an important role in solving the problem. Early constrained image reconstruction methods utilize image priors based on general image properties such as sparsity, low-rank structures, spatial support bound, etc. Recent deep learning-based reconstruction methods promise to produce even higher quality reconstructions by utilizing more specific image priors learned from training data. However, learning high-dimensional image priors requires huge amounts of training data that are currently not available in medical imaging applications. As a result, deep learning-based reconstructions often suffer from two known practical issues: a) sensitivity to data perturbations (e.g., changes in data sampling scheme), and b) limited generalization capability (e.g., biased reconstruction of lesions). This paper proposes a new method to address these issues. The proposed method synergistically integrates model-based and data-driven learning in three key components. The first component uses the linear vector space framework to capture global dependence of image features; the second exploits a deep network to learn the mapping from a linear vector space to a nonlinear manifold; the third is an unrolling-based deep network that captures local residual features with the aid of a sparsity model. The proposed method has been evaluated with magnetic resonance imaging data, demonstrating improved reconstruction in the presence of data perturbation and/or novel image features. The method may enhance the practical utility of deep learning-based image reconstruction.

Learning of Patch-Based Smooth-Plus-Sparse Models for Image Reconstruction

Image reconstructions using sparse dictionary representations and implicit, non-negative mappings

Learning from small data sets: Patch-based regularizers in inverse problems for image reconstruction

Sparse representation and dictionary learning penalized image reconstruction for positron emission tomography.

Low-Rank Plus Sparse Reconstruction Using Dictionary Learning for 3D-Mri

Patch-based Image Reconstruction for PET Using Prior-Image Derived Dictionaries

Two-layer Residual Sparsifying Transform Learning for Image Reconstruction

Subspace Model-Assisted Deep Learning for Improved Image Reconstruction.

Image Reconstruction with Locally Adaptive Sparsity and Nonlocal Robust Regularization

MR image reconstruction by patch-based sparse representation

Supervised Learning of Sparsity-Promoting Regularizers for Denoising

Image Deblurring and Super-Resolution by Adaptive Sparse Domain Selection and Adaptive Regularization.

Image Reconstruction with Smoothed Mixtures of Regressions

Learning Sparse and Low-Rank Priors for Image Recovery via Iterative Reweighted Least Squares Minimization

A Decoupled Approach for Composite Sparse-plus-Smooth Penalized Optimization

Model-based Reconstruction with Learning: From Unsupervised to Supervised and Beyond

Resolution Enhancement Based on Learning the Sparse Association of Image Patches

Enhancing Low-dose CT Image Reconstruction by Integrating Supervised and Unsupervised Learning

Learned convex regularizers for inverse problems

Unsupervised approaches based on optimal transport and convex analysis for inverse problems in imaging

Image Reconstruction via Deep Image Prior Subspaces