Abstract:Objective.Unrolled algorithms are a promising approach for reconstruction of CT images in challenging scenarios, such as low-dose, sparse-view and limited-angle imaging. In an unrolled algorithm, a fixed number of iterations of a reconstruction method are unrolled into multiple layers of a neural network, and interspersed with trainable layers. The entire network is then trained end-to-end in a supervised fashion, to learn an appropriate regularizer from training data. In this paper we propose a novel unrolled algorithm, and compare its performance with several other approaches on sparse-view and limited-angle CT.Approach.The proposed algorithm is inspired by the superiorization methodology, an optimization heuristic in which iterates of a feasibility-seeking method are perturbed between iterations, typically using descent directions of a model-based penalty function. Our algorithm instead uses a modified U-net architecture to introduce the perturbations, allowing a network to learn beneficial perturbations to the image at various stages of the reconstruction, based on the training data.Main Results.In several numerical experiments modeling sparse-view and limited angle CT scenarios, the algorithm provides excellent results. In particular, it outperforms several competing unrolled methods in limited-angle scenarios, while providing comparable or better performance on sparse-view scenarios.Significance.This work represents a first step towards exploiting the power of deep learning within the superiorization methodology. Additionally, it studies the effect of network architecture on the performance of unrolled methods, as well as the effectiveness of the unrolled approach on both limited-angle CT, where previous studies have primarily focused on the sparse-view and low-dose cases.

Algorithm Unrolling: Interpretable, Efficient Deep Learning for Signal and Image Processing

Deep Algorithm Unrolling for Biomedical Imaging

Deep, convergent, unrolled half-quadratic splitting for image deconvolution

A statistical perspective on algorithm unrolling models for inverse problems

Interpretable deep learning for deconvolutional analysis of neural signals

Deep Unrolled Recovery in Sparse Biological Imaging

Robust Stochastically-Descending Unrolled Networks

Unrolled denoising networks provably learn optimal Bayesian inference

Interpretable Deep Recurrent Neural Networks via Unfolding Reweighted $\ell_1$-$\ell_1$ Minimization: Architecture Design and Generalization Analysis

Superiorization-inspired unrolled SART algorithm with U-Net generated perturbations for sparse-view and limited-angle CT reconstruction

Deep unfolding as iterative regularization for imaging inverse problems

Graph Unrolling Networks: Interpretable Neural Networks for Graph Signal Denoising

Operator Sketching for Deep Unrolling Networks

Equilibrated Zeroth-Order Unrolled Deep Network for Parallel MR Imaging

Analyzing and Enhancing the Backward-Pass Convergence of Unrolled Optimization

Model-driven deep unrolling: Towards interpretable deep learning against noise attacks for intelligent fault diagnosis

Interpretable Lightweight Transformer via Unrolling of Learned Graph Smoothness Priors

Backpropagation of Unrolled Solvers with Folded Optimization

Unrolling Plug-and-Play Gradient Graph Laplacian Regularizer for Image Restoration

Towards Understanding Graph Neural Networks: An Algorithm Unrolling Perspective