Abstract:This is a continued study of Li et al. (2011) for the regularization of ill-conditioning problems, where the minimal singular value σmin of discrete matrices is infinitesimal. To remove the effects of high frequency caused by the singular vector of σmin better, we combine the Tikhonov regularization (TR) with the truncated singular value decomposition (TSVD) (simply denoted by T-TR). New computational formulas of the traditional condition number (Cond) and the effective condition number (Cond_eff) are derived, and a brief error analysis is made. The regularization parameter λ is involved in the TR, and its better (or optimal) choices are essential in both theory and computation. For ill-conditioning problems, stability is more imperative than accuracy. The most important criterion is to reduce the Cond. Consider the linear algebraic equations Ax = b. The optimal regularization parameter for the TR is derived as λ=σmaxσmin, where σmax and σmin(>0) are the maximal and the minimal singular values of matrix A, respectively. The L-curve techniques emphasize the ill-conditioning of ‖xλ‖ (see Hansen (1998)). Note that the norm ‖xλ‖ is only part of the Cond in stability. In fact, by using regularization, the Cond may be greatly reduced, while the errors do not increase much. The second important criterion is for both stability and solution accuracy. The sensitivity index proposed in Zhang et al. (2021) indicates the severity of ill-conditioning via accuracy for comparing different numerical methods and techniques. The sensitivity index is effective not only to select the source nodes in the method of fundamental solutions (MFS), but also to select the regularization parameter in the TR. The regularization choices of the T-TR are similar to those of the TR because differences of the Cond and the errors between the TR and the T-TR are insignificant. Numerical experiments are reported by the MFS for Laplace’s equation, to support the new regularization techniques proposed. For data fitting, imaging processing, pattern recognition, and machine learning, the ‖xλ‖ is, however, more important than Cond for ill-conditioning. The L-curve techniques are used in wide applications, and discussed in Hansen (1998). The parameter choices are rather complicated if the crossover region is not small. In this paper, we apply the sensitivity index to L-curves, the optimal parameter λL−curve can be found by the minimal sensitivity index. The λL−curve may also be found by the lowest line that passes the origin. The new algorithms are simple and effective.

Effective Condition Number for Weighted Linear Least Squares Problems and Applications to the Trefftz Method

Effective Condition Number and Its Applications

Effective Condition Number of Trefftz Methods for Biharmonic Equations with Crack Singularities.

The Method of Weighted Residuals for Transversely Isotropic Axisymmetric Problems and Its Applications to Engineering

Condition Numbers and Perturbation of the Weighted Moore-Penrose Inverse and Weighted Linear Least Squares Problem.

New Regularization Techniques for Ill-Conditioning Problems and Their Applications: Choices of Regularization Parameters

On Level-2 Condition Number for the Weighted Moore–Penrose Inverse

Condition Numbers of Multidimensional Mixed Least Squares-Total Least Squares Problems

Ill-Conditioning Of The Truncated Singular Value Decomposition, Tikhonov Regularization And Their Applications To Numerical Partial Differential Equations

The numerical linear algebra of weights: from the spectral analysis to conditioning and preconditioning in the Laplacian case

A contribution to the condition number of the total least squares problem

Stability Analysis Via Condition Number and Effective Condition Number for the First Kind Boundary Integral Equations by Advanced Quadrature Methods, a Comparison

Multilevel Tau preconditioners for symmetrized multilevel Toeplitz systems with applications to solving space fractional diffusion equations

Condition Numbers and Perturbation Analysis for the Tikhonov Regularization of Discrete Ill-Posed Problems.

Condition Numbers of the Multidimensional Total Least Squares Problems Having More Than One Solution

CONDITION NUMBERS OF THE MULTIDIMENSIONAL TOTAL LEAST SQUARES PROBLEM

Condition numbers for the truncated total least squares problem and their estimations

Stability analysis for singularly perturbed differential equations by the upwind difference scheme

On the Condition Number of the Total Least Squares Problem

A novel coarse space applying to the weighted Schwarz method for Helmholtz equations

Condition Numbers for the Outer Inverse and Constrained Singular Linear System