Abstract:The proximal alternating linearized minimization method (PALM) suits well for solving block-structured optimization problems, which are ubiquitous in real applications. In the cases where subproblems do not have closed-form solutions, e.g., due to complex constraints, infeasible subsolvers are indispensable, giving rise to an infeasible inexact PALM (PALM-I). Numerous efforts have been devoted to analyzing feasible PALM, while little attention has been paid to PALM-I. The usage of PALM-I thus lacks theoretical guarantee. The essential difficulty of analyses consists in the objective value nonmonotonicity induced by the infeasibility. We study in the present work the convergence properties of PALM-I. In particular, we construct a surrogate sequence to surmount the nonmonotonicity issue and devise an implementable inexact criterion. Based upon these, we manage to establish the stationarity of any accumulation point and, moreover, show the iterate convergence and the asymptotic convergence rates under the assumption of the Lojasiewicz property. The prominent advantages of PALM-I on CPU time are illustrated via numerical experiments on problems arising from quantum physics and 3D anisotropic frictional contact.

On the Global Convergence of A Parameter-Adjusting Levenberg-Marquardt Method

Convergence analysis of LM method for semismooth equations

A New Adaptive Levenberg–Marquardt Method for Nonlinear Equations and Its Convergence Rate under the Hölderian Local Error Bound Condition

A PARAMETER-SELF-ADJUSTING LEVENBERG-MARQUARDT METHOD FOR SOLVING NONSMOOTH EQUATIONS

On a New Updating Rule of the Levenberg–Marquardt Parameter

On the Convergence of Levenberg-Marquardt Method for Solving Nonlinear Systems.

The convergence of conjugate gradient method with nonmonotone line search

The Modified Levenberg-Marquardt Method for Nonlinear Equations with Cubic Convergence

Accelerating the Modified Levenberg-Marquardt Method for Nonlinear Equations.

A Note on the Levenberg-Marquardt Parameter

An Adaptive Multi-step Levenberg–Marquardt Method

A Generalized Adaptive Levenberg–Marquardt Method for Solving Nonlinear Ill-Posed Problems

Convergence Properties of a Self-adaptive Levenberg-Marquardt Algorithm under Local Error Bound Condition

An accelerated adaptive two-step Levenberg–Marquardt method with the modified Metropolis criterion

A Shamanskii-like Levenberg-Marquardt Method for Nonlinear Equations

Global Complexity Bound of the Levenberg–Marquardt Method

Riemannian Levenberg-Marquardt Method with Global and Local Convergence Properties

Convergence Rate of the Levenberg-Marquardt Method under Hölderian Local Error Bound

On the Convergence Rate of the Inexact Levenberg-Marquardt Method

The Convergence Properties of Infeasible Inexact Proximal Alternating Linearized Minimization

Fast Proximal Linearized Alternating Direction Method of Multiplier with Parallel Splitting