Abstract:We propose a sequential homotopy method for the solution of mathematical programming problems formulated in abstract Hilbert spaces under the Guignard constraint qualification. The method is equivalent to performing projected backward Euler timestepping on a projected gradient/antigradient flow of the augmented Lagrangian. The projected backward Euler equations can be interpreted as the necessary optimality conditions of a primal-dual proximal regularization of the original problem. The regularized problems are always feasible, satisfy a strong constraint qualification guaranteeing uniqueness of Lagrange multipliers, yield unique primal solutions provided that the stepsize is sufficiently small, and can be solved by a continuation in the stepsize. We show that equilibria of the projected gradient/antigradient flow and critical points of the optimization problem are identical, provide sufficient conditions for the existence of global flow solutions, and show that critical points with emanating descent curves cannot be asymptotically stable equilibria of the projected gradient/antigradient flow, practically eradicating convergence to saddle points and maxima. The sequential homotopy method can be used to globalize any locally convergent optimization method that can be used in a homotopy framework. We demonstrate its efficiency for a class of highly nonlinear and badly conditioned control constrained elliptic optimal control problems with a semismooth Newton approach for the regularized subproblems. In contrast to the published article, this version contains a correction that the associate editor considers as too insignificant to justify publication in the journal.

An Accelerated Sequential Subspace Optimization Method Based On Homotopy Perturbation Iteration For Nonlinear Ill-Posed Problems

Subspace-based Optimization Method Coupled with Multiplicative Regularization for Edge-Preserving Inversion

Riemannian Linearized Proximal Algorithms for Nonnegative Inverse Eigenvalue Problem.

A Sequential Homotopy Method for Mathematical Programming Problems

Nonlinear Homotopy Interior-Point Algorithm for 6-Dof Powered Landing Guidance

Subspace Methods for Nonlinear Optimization

An iteration regularization method with general convex penalty for nonlinear inverse problems in Banach spaces

A nested primal–dual iterated Tikhonov method for regularized convex optimization

Advancing Nonlinear Problem Solutions: Newton-Like Iterative Techniques for Varied Convergence Orders using Homotopy Perturbation

An asymptotical regularization with convex constraints for inverse problems

An Analysis of a Multi-Level Projected Steepest Descent Iteration for Nonlinear Inverse Problems in Banach Spaces Subject to Stability Constraints

Stochastic variance reduced gradient method for linear ill-posed inverse problems

Numerical Solution of Inverse Scattering Problems with Multi-experimental Limited Aperture Data

A fast iterative regularization method for ill-posed problems

A preconditioned Krylov subspace method for linear inverse problems with general-form Tikhonov regularization

A Proximal-Gradient Homotopy Method for the Sparse Least-Squares Problem

On adapting Nesterov's scheme to accelerate iterative methods for linear problems

Nonlinearly preconditioned semismooth Newton algorithms for nonlinear nonsmooth systems

A preconditioned alternating minimization framework for nonconvex and half quadratic regularization

Minimization Over the Nonconvex Sparsity Constraint Using A Hybrid First-order method

A modified iteratively regularized Landweber iteration method: Hölder stability and convergence rates