Abstract:Model-based deep learning methods such as loop unrolling (LU) and deep equilibrium model}(DEQ) extensions offer outstanding performance in solving inverse problems (IP). These methods unroll the optimization iterations into a sequence of neural networks that in effect learn a regularization function from data. While these architectures are currently state-of-the-art in numerous applications, their success heavily relies on the accuracy of the forward model. This assumption can be limiting in many physical applications due to model simplifications or uncertainties in the apparatus. To address forward model mismatch, we introduce an untrained forward model residual block within the model-based architecture to match the data consistency in the measurement domain for each instance. We propose two variants in well-known model-based architectures (LU and DEQ) and prove convergence under mild conditions. Our approach offers a unified solution that is less parameter-sensitive, requires no additional data, and enables simultaneous fitting of the forward model and reconstruction in a single pass, benefiting both linear and nonlinear inverse problems. The experiments show significant quality improvement in removing artifacts and preserving details across three distinct applications, encompassing both linear and nonlinear inverse problems. Moreover, we highlight reconstruction effectiveness in intermediate steps and showcase robustness to random initialization of the residual block and a higher number of iterations during evaluation. Code is available at \texttt{<a class="link-external link-https" href="https://github.com/InvProbs/A-adaptive-model-based-methods" rel="external noopener nofollow">this https URL</a>}.

Discrepancy based model selection in statistical inverse problems

Discrepancy Curves for Multi-Parameter Regularization

Generalized Bayes Approach to Inverse Problems with Model Misspecification

Choosing observation operators to mitigate model error in Bayesian inverse problems

Model Misfit Minimization

Sparsity enforcing priors in inverse problems via Normal variance mixtures: model selection, algorithms and applications

Surrogate-Based Inverse Modeling of the Hydrological System: An Adaptive Approach Considering Surrogate Structural Error.

Non-asymptotic model selection for linear non least-squares estimation in regression models and inverse problems

Heuristic Parameter Selection Based on Functional Minimization: Optimality and Model Function Approach

Hyper-differential sensitivity analysis with respect to model discrepancy: Posterior Optimal Solution Sampling

On the Discrepancy Principle for Stochastic Gradient Descent

On Learning the Optimal Regularization Parameter in Inverse Problems

Towards optimal sensor placement for inverse problems in spaces of measures

Hierarchical Bayesian Inverse Problems: A High-Dimensional Statistics Viewpoint

On the Generalized Discrepancy Principle for Tikhonov Regularization in Hilbert Scales

A Fully Bayesian Approach to Assessment of Model Adequacy in Inverse Problems

Weighted inhomogeneous regularization for inverse problems with indirect and incomplete measurement data

Solving Inverse Problems with Model Mismatch using Untrained Neural Networks within Model-based Architectures

Unique reconstruction for discretized inverse problems: a random sketching approach via subsampling

Off-the-grid regularisation for Poisson inverse problems