Abstract:Purpose: Signal models based on sparse representations have received considerable attention in recent years. On the other hand, deep models consisting of a cascade of functional layers, commonly known as deep neural networks, have been highly successful for the task of object classification and have been recently introduced to image reconstruction. In this work, we develop a new image reconstruction approach based on a novel multilayer model learned in an unsupervised manner by combining both sparse representations and deep models. The proposed framework extends the classical sparsifying transform model for images to a Multilayer residual sparsifying transform (MARS) model, wherein the transform domain data are jointly sparsified over layers. We investigate the application of MARS models learned from limited regular-dose images for low-dose CT reconstruction using penalized weighted least squares (PWLS) optimization. Methods: We propose new formulations for multilayer transform learning and image reconstruction. We derive an efficient block coordinate descent algorithm to learn the transforms across layers, in an unsupervised manner from limited regular-dose images. The learned model is then incorporated into the low-dose image reconstruction phase. Results: Low-dose CT experimental results with both the XCAT phantom and Mayo Clinic data show that the MARS model outperforms conventional methods such as filtered back-projection and PWLS methods based on the edge-preserving (EP) regularizer in terms of two numerical metrics (RMSE and SSIM) and noise suppression. Compared with the single-layer learned transform (ST) model, the MARS model performs better in maintaining some subtle details. Conclusions: This work presents a novel data-driven regularization framework for CT image reconstruction that exploits learned multilayer or cascaded residual sparsifying transforms. The image model is learned in an unsupervised manner from limited images. Our experimental results demonstrate the promising performance of the proposed multilayer scheme over single-layer learned sparsifying transforms. Learned MARS models also offer better image quality than typical nonadaptive PWLS methods.

Two-layer Residual Sparsifying Transform Learning for Image Reconstruction

Learned Multi-layer Residual Sparsifying Transform Model for Low-dose CT Reconstruction

Subspace Model-Assisted Deep Learning for Improved Image Reconstruction.

Multilayer residual sparsifying transform (MARS) model for low-dose CT image reconstruction

Image Reconstruction: From Sparsity to Data-adaptive Methods and Machine Learning

Learning Multi-Layer Transform Models

Low-Rank Plus Sparse Reconstruction Using Dictionary Learning for 3D-Mri

Weighted Tensor Low-Rankness and Learnable Analysis Sparse Representation Model for Texture Preserving Low-Dose CT Reconstruction

Enhancing Low-dose CT Image Reconstruction by Integrating Supervised and Unsupervised Learning

Learning Sparse and Low-Rank Priors for Image Recovery via Iterative Reweighted Least Squares Minimization

Combining Deep Learning and Adaptive Sparse Modeling for Low-dose CT Reconstruction

Supervised Transform Learning for Limited Angle Tomographic Reconstruction

SINGLE IMAGE SUPER RESOLUTION VIA COUPLED SPARSE AND LOW RANK DICTIONARY LEARNING

Laplacian and Bilateral Weighted Relative Total Variation Sparse Angle CT Reconstruction

Joint Learning Sparsifying Linear Transformation for Low-Resolution Image Synthesis and Recognition

Fast Parallel Magnetic Resonance Imaging Reconstruction Based on Sparsifying Transform Learning and Structured Low-Rank Model

Deep residual constrained reconstruction via learned convolutional sparse coding for low-dose CT imaging

Low-Dose CT Image Post-Processing Based on Learn-Type Sparse Transform

Hierarchical decomposed dual-domain deep learning for sparse-view CT reconstruction

Dual-Domain Reconstruction Network Incorporating Multi-Level Wavelet Transform and Recurrent Convolution for Sparse View Computed Tomography Imaging

LIR-Net:Learnable Iterative Reconstruction Network for Fan Beam CT Sparse-View Reconstruction