Abstract:For linear ill-posed problems with nontrivial null spaces, Tikhonov regularization and truncated singular value decomposition (TSVD) typically yield solutions that are close to the minimum norm solution. Such a bias is not always desirable, and we have therefore in a series of papers developed a weighting procedure which produces solutions with a different and controlled bias. This methodology can also conveniently be invoked when sparsity regularization is employed. The purpose of the present work is to study the potential use of this weighting applied to injective operators. The image under a compact operator of the singular vectors/functions associated with very small singular values will be almost zero. Consequently, one may regard these singular vectors/functions to constitute a basis for a fictitious null space that allows us to mimic the previous weighting procedure. It turns out that this regularization by weighting can improve the solution of injective inverse problems compared with more traditional approaches. We present some analysis of this methodology and exemplify it numerically, using sparsity regularization, for three PDE-driven inverse problems: the inverse heat conduction problem, the Cauchy problem for Laplace's equation, and the (linearized) Electrical Impedance Tomography problem with experimental data.

What problem does this paper attempt to address?

### Problems Addressed by the Paper This paper aims to study the application and improvement effects of a weighted regularization method in dealing with injective inverse problems. Specifically: 1. **Background**: - For linear ill-posed problems (with non-trivial null spaces), Tikhonov regularization and truncated singular value decomposition (TSVD) usually produce solutions close to the minimum norm. This bias is not ideal in some cases. - The authors previously developed a weighted method that can produce different, controlled biases in non-injective problems, and this method can also be used for sparse regularization. 2. **Objective**: - To study how this weighted method can be applied to the case of injective operators. Since the singular vectors/functions corresponding to the small singular values of injective operators are almost zero, these singular vectors/functions can be regarded as the basis of a "fictitious null space," thereby mimicking the previous weighted method. - To find that this weighted regularization method has better performance in dealing with injective inverse problems compared to traditional methods. 3. **Specific Methods**: - Defined and analyzed the weighted regularization method and verified its effectiveness through numerical experiments. - Considered three inverse problems driven by partial differential equations: the inverse heat conduction problem, the Cauchy problem for the Laplace equation, and the linearized electrical impedance tomography (EIT) problem with experimental data. 4. **Main Contributions**: - Proposed the weighted regularization method and demonstrated that it can recover the true source composed of a single basis function with smaller errors, which standard methods cannot achieve. - Analyzed the convergence of this method as the noise tends to zero. - Numerical experiments show that the weighted regularization method significantly improves the reconstruction quality in three complex inverse problems. In summary, the main purpose of this paper is to explore a new weighted regularization method and demonstrate its effectiveness and superiority in dealing with injective inverse problems.

Fictitious null spaces for improving the solution of injective inverse problems

A sparse optimization approach to infinite infimal convolution regularization

Extended Newton-type Method for Inverse Singular Value Problems with Multiple And/or Zero Singular Values

A preconditioned Krylov subspace method for linear inverse problems with general-form Tikhonov regularization

Ground States and Singular Vectors of Convex Variational Regularization Methods

Perturbation Identities for Regularized Tikhonov Inverses and Weighted Pseudoinverses

Data-proximal null-space networks for inverse problems

Image reconstructions using sparse dictionary representations and implicit, non-negative mappings

A-optimal encoding weights for nonlinear inverse problems, with application to the Helmholtz inverse problem

A novel iterative integration regularization method for ill-posed inverse problems

Learning the optimal Tikhonov regularizer for inverse problems

An Extended Ulm-like Method for Inverse Singular Value Problems with Multiple And/or Zero Singular Values

Study of Travel Time Tomography by Iterative Tikhonov Regularization Inversion

Box Constraints and Weighted Sparsity Regularization for Identifying Sources in Elliptic PDEs

Weighted inhomogeneous regularization for inverse problems with indirect and incomplete measurement data

Generalizing the SVD of a matrix under non-standard inner product and its applications to linear ill-posed problems

Least squares formulation for ill-posed inverse problems and applications

A model reduction approach for inverse problems with operator valued data

DRIP: Deep Regularizers for Inverse Problems

Nonstationary iterated frozen Tikhonov regularization with uniformly convex penalty terms for solving inverse problems

Generalized Tikhonov regularization method for large-scale linear inverse problems