Abstract:Motivated by localization problems such as cadastral maps refinements, we consider a generic Nonlinear Least Squares (NLS) problem of minimizing an aggregate squared fit across all nonlinear equations (measurements) with respect to the set of unknowns, e.g., coordinates of the unknown points' locations. In a number of scenarios, NLS problems exhibit a nearly-separable structure: the set of measurements can be partitioned into disjoint groups (blocks), such that the unknowns that correspond to different blocks are only loosely coupled. We propose an efficient parallel method, termed Parallel Inexact Levenberg Marquardt (PILM), to solve such generic large scale NLS problems. PILM builds upon the classical Levenberg-Marquard (LM) method, with a main novelty in that the nearly-block separable structure is leveraged in order to obtain a scalable parallel method. Therein, the problem-wide system of linear equations that needs to be solved at every LM iteration is tackled iteratively. At each (inner) iteration, the block-wise systems of linear equations are solved in parallel, while the problem-wide system is then handled via sparse, inexpensive inter-block communication. We establish strong convergence guarantees of PILM that are analogous to those of the classical LM; provide PILM implementation in a master-worker parallel compute environment; and demonstrate its efficiency on huge scale cadastral map refinement problems.

On inertial Levenberg-Marquardt type methods for solving nonlinear ill-posed operator equations

On inertial iterated Tikhonov methods for solving ill-posed problems

Error estimates for simplified Levenberg–Marquardt method for nonlinear ill-posed operator equations in Hilbert Spaces

Local Convergence of Inexact Methods under the Hölder Condition

Modified iterated Tikhonov methods for solving systems of nonlinear ill-posed equations

A fresh look at nonsmooth Levenberg–Marquardt methods with applications to bilevel optimization

A Ulm-like Method for Inverse Eigenvalue Problems

Inertial Krasnoselskii-Mann Iterations

A New Adaptive Levenberg–Marquardt Method for Nonlinear Equations and Its Convergence Rate under the Hölderian Local Error Bound Condition

A strongly convergent inertial inexact proximal-point algorithm for monotone inclusions with applications to variational inequalities

Bounded perturbations resilient iterative methods for linear systems and least squares problems: operator-based approaches, analysis, and performance evaluation

The Levenberg–Marquardt method: an overview of modern convergence theories and more

Levenberg-Marquardt method with Singular Scaling and applications

Easily implementable iterative methods for variational inequalities with nonlinear diffusion–convection operator and constraints to the gradient of solution

A data-driven iteratively regularized Landweber iteration

An Analysis of a Multi-Level Projected Steepest Descent Iteration for Nonlinear Inverse Problems in Banach Spaces Subject to Stability Constraints

Inertial iterative method for solving equilibrium problems and fixed point problems

A rational conjugate gradient method for linear ill-conditioned problems

Parallel Inexact Levenberg-Marquardt Method for Nearly-Separable Nonlinear Least Squares