Abstract:Inverse imaging problems (IIPs) arise in various applications, with the main objective of reconstructing an image from its compressed measurements. This problem is often ill-posed for being under-determined with multiple interchangeably consistent solutions. The best solution inherently depends on prior knowledge or assumptions, such as the sparsity of the image. Furthermore, the reconstruction process for most IIPs relies significantly on the imaging (i.e. forward model) parameters, which might not be fully known, or the measurement device may undergo calibration drifts. These uncertainties in the forward model create substantial challenges, where inaccurate reconstructions usually happen when the postulated parameters of the forward model do not fully match the actual ones. In this work, we devoted to tackling accurate reconstruction under the context of a set of possible forward model parameters that exist. Here, we propose a novel Moment-Aggregation (MA) framework that is compatible with the popular IIP solution by using a neural network prior. Specifically, our method can reconstruct the signal by considering all candidate parameters of the forward model simultaneously during the update of the neural network. We theoretically demonstrate the convergence of the MA framework, which has a similar complexity with reconstruction under the known forward model parameters. Proof-of-concept experiments demonstrate that the proposed MA achieves performance comparable to the forward model with the known precise parameter in reconstruction across both compressive sensing and phase retrieval applications, with a PSNR gap of 0.17 to 1.94 over various datasets, including MNIST, X-ray, Glas, and MoNuseg. This highlights our method's significant potential in reconstruction under an uncertain forward model.

Untrained Low-Rank Neural Network Prior for Multi-Dimensional Image Recovery

UDRN: Unified Dimensional Reduction Neural Network for Feature Selection and Feature Projection.

UDRN: Unified Dimensional Reduction Neural Network for Feature Selection and Feature Projection

Tensor Nonconvex Unified Prior For Tensor Recovery

Untrained Neural Network Priors for Inverse Imaging Problems: A Survey

Self-Supervised Nonlinear Transform-Based Tensor Nuclear Norm for Multi-Dimensional Image Recovery

Deep plug-and-play prior for low-rank tensor completion

Learnable Spatial-Spectral Transform-Based Tensor Nuclear Norm for Multi-Dimensional Visual Data Recovery

Indoor Depth Recovery Based on Deep Unfolding with Non-Local Prior

Image Inpainting Algorithm Based on Tensor Decomposition and Weighted Nuclear Norm

T$^2$LR-Net: An Unrolling Reconstruction Network Learning Transformed Tensor Low-Rank prior for Dynamic MR Imaging

Learning Sparse and Low-Rank Priors for Image Recovery via Iterative Reweighted Least Squares Minimization

Reweighted Low-Rank Factorization with Deep Prior for Image Restoration.

Robust Low-Rank Tensor Recovery Via Nonconvex Singular Value Minimization.

Image Restoration Based on End-to-End Unrolled Network

Untrained Neural Nets for Snapshot Compressive Imaging: Theory and Algorithms

Fast Unsupervised Tensor Restoration via Low-rank Deconvolution

Multiscale Feature Tensor Train Rank Minimization for Multidimensional Image Recovery

Imaging Signal Recovery Using Neural Network Priors Under Uncertain Forward Model Parameters

Nested Fully-Connected Tensor Network Decomposition for Multi-Dimensional Visual Data Recovery

Random Weights Networks Work as Loss Prior Constraint for Image Restoration