Abstract:Medical imaging is crucial in modern clinics to provide guidance to the diagnosis and treatment of diseases. Medical image reconstruction is one of the most fundamental and important components of medical imaging, whose major objective is to acquire high-quality medical images for clinical usage at the minimal cost and risk to the patients. Mathematical models in medical image reconstruction or, more generally, image restoration in computer vision have been playing a prominent role. Earlier mathematical models are mostly designed by human knowledge or hypothesis on the image to be reconstructed, and we shall call these models handcrafted models. Later, handcrafted plus data-driven modeling started to emerge which still mostly relies on human designs, while part of the model is learned from the observed data. More recently, as more data and computation resources are made available, deep learning based models (or deep models) pushed the data-driven modeling to the extreme where the models are mostly based on learning with minimal human designs. Both handcrafted and data-driven modeling have their own advantages and disadvantages. Typical handcrafted models are well interpretable with solid theoretical supports on the robustness, recoverability, complexity, etc., whereas they may not be flexible and sophisticated enough to fully leverage large data sets. Data-driven models, especially deep models, on the other hand, are generally much more flexible and effective in extracting useful information from large data sets, while they are currently still in lack of theoretical foundations. Therefore, one of the major research trends in medical imaging is to combine handcrafted modeling with deep modeling so that we can enjoy benefits from both approaches. The major part of this article is to provide a conceptual review of some recent works on deep modeling from the unrolling dynamics viewpoint. This viewpoint stimulates new designs of neural network architectures with inspirations from optimization algorithms and numerical differential equations. Given the popularity of deep modeling, there are still vast remaining challenges in the field, as well as opportunities which we shall discuss at the end of this article.

A Review of Deep Learning Methods for Compressed Sensing Image Reconstruction and Its Medical Applications

Deep Learning for Under-Sampled Non-Cartesian ASL MRI Reconstruction

A review on deep learning MRI reconstruction without fully sampled k-space

Fast MRI Reconstruction Using Deep Learning-based Compressed Sensing: A Systematic Review

A Review on Deep Learning in Medical Image Reconstruction

Deep Learning-Based Image Reconstruction for Different Medical Imaging Modalities

Application of deep learning and compressed sensing for reconstruction of images

A Review of Deep Learning CT Reconstruction From Incomplete Projection Data

Compressed Sensing: From Research to Clinical Practice with Deep Neural Networks

Deep learning for tomographic image reconstruction

Deep MRI Reconstruction: Unrolled Optimization Algorithms Meet Neural Networks

AI-Based Reconstruction for Fast MRI—A Systematic Review and Meta-Analysis

Reference-Driven Compressed Sensing MR Image Reconstruction Using Deep Convolutional Neural Networks without Pre-Training

A Systematic Literature Review of 3D Deep Learning Techniques in Computed Tomography Reconstruction

New Advances of Compressed Sensing in Medical Image Reconstruction

Medical Imaging Using Machine Learning and Deep Learning Algorithms: A Review

A survey on deep learning in medical image reconstruction

Deep Learning-Based Reconstruction for Cardiac MRI: A Review

Subspace Model-Assisted Deep Learning for Improved Image Reconstruction.

Review and Prospect: Artificial Intelligence in Advanced Medical Imaging

Applying Deep Learning to Medical Imaging: A Review