Abstract:In this paper, we revisit the classical problem of solving over-determined systems of nonsmooth equations numerically. We suggest a nonsmooth Levenberg–Marquardt method for its solution which, in contrast to the existing literature, does not require local Lipschitzness of the data functions. This is possible when using Newton-differentiability instead of semismoothness as the underlying tool of generalized differentiation. Conditions for local fast convergence of the method are given. Afterwards, in the context of over-determined mixed nonlinear complementarity systems, our findings are applied, and globalized solution methods, based on a residual induced by the maximum and the Fischer–Burmeister function, respectively, are constructed. The assumptions for local fast convergence are worked out and compared. Finally, these methods are applied for the numerical solution of bilevel optimization problems. We recall the derivation of a stationarity condition taking the shape of an over-determined mixed nonlinear complementarity system involving a penalty parameter, formulate assumptions for local fast convergence of our solution methods explicitly, and present results of numerical experiments. Particularly, we investigate whether the treatment of the appearing penalty parameter as an additional variable is beneficial or not.

An explicit spectral Fletcher–Reeves conjugate gradient method for bi-criteria optimization

Optimization of unconstrained problems using a developed algorithm of spectral conjugate gradient method calculation

An inertial Fletcher–Reeves-type conjugate gradient projection-based method and its spectral extension for constrained nonlinear equations

A spectral three-term Hestenes–Stiefel conjugate gradient method

Conjugate gradient methods without line search for multiobjective optimization

Barzilai and Borwein conjugate gradient method equipped with a non-monotone line search technique and its application on non-negative matrix factorization

Convergence of Inexact Steepest Descent Algorithm for Multiobjective Optimizations on Riemannian Manifolds Without Curvature Constraints

Spectral conjugate gradient methods for vector optimization problems

A modified Polak-Ribiere-Polyak type conjugate gradient method with two stepsize strategies for vector optimization

Two families of scaled three-term conjugate gradient methods with sufficient descent property for nonconvex optimization

Gauss-Southwell type descent methods for low-rank matrix optimization

A self-scaling memoryless BFGS based conjugate gradient method using multi-step secant condition for unconstrained minimization

A BFGS-SQP method for nonsmooth, nonconvex, constrained optimization and its evaluation using relative minimization profiles

A projected hybridization of the Hestenes–Stiefel and Dai–Yuan conjugate gradient methods with application to nonnegative matrix factorization

A fresh look at nonsmooth Levenberg–Marquardt methods with applications to bilevel optimization

A family of three-term conjugate gradient methods with sufficient descent property for unconstrained optimization

A family of three-term conjugate gradient projection methods with a restart procedure and their relaxed-inertial extensions for the constrained nonlinear pseudo-monotone equations with applications

A scaled three-term conjugate gradient method for unconstrained optimization

A convergent hybrid three-term conjugate gradient method with sufficient descent property for unconstrained optimization

A revised Liu–Storey conjugate gradient parameter for unconstrained optimization problems with applications

Two sufficient descent three-term conjugate gradient methods for unconstrained optimization problems with applications in compressive sensing