Abstract:The derivative-free projection method (DFPM) is an effective and classic approach for solving the system of nonlinear monotone equations with convex constraints, but the global convergence or convergence rate of the DFPM is typically analyzed under the Lipschitz continuity. This observation motivates us to propose an inertial hybrid DFPM-based algorithm, which incorporates a modified conjugate parameter utilizing a hybridized technique, to weaken the convergence assumption. By integrating an improved inertial extrapolation step and the restart procedure into the search direction, the resulting direction satisfies the sufficient descent and trust region properties, which independent of line search choices. Under weaker conditions, we establish the global convergence and Q-linear convergence rate of the proposed algorithm. To the best of our knowledge, this is the first analysis of the Q-linear convergence rate under the condition that the mapping is locally Lipschitz continuous. Finally, by applying the Bayesian hyperparameter optimization technique, a series of numerical experiment results demonstrate that the new algorithm has advantages in solving nonlinear monotone equation systems with convex constraints and handling compressed sensing problems.

An inertial Fletcher–Reeves-type conjugate gradient projection-based method and its spectral extension for constrained nonlinear equations

Convergence of Projected Subgradient Method with Sparse or Low-Rank Constraints

An Improved Inertial Projection Method for Solving Convex Constrained Monotone Nonlinear Equations with Applications

An inertial hybrid DFPM-based algorithm for constrained nonlinear equations with applications

A modified inertial three-term conjugate gradient projection method for constrained nonlinear equations with applications in compressed sensing

An Adaptive Family of Projection Methods for Constrained Monotone Nonlinear Equations with Applications

A hybrid three-term conjugate gradient projection method for constrained nonlinear monotone equations with applications

A family of three-term conjugate gradient projection methods with a restart procedure and their relaxed-inertial extensions for the constrained nonlinear pseudo-monotone equations with applications

A conjugate gradient projection method with restart procedure for solving constraint equations and image restorations

An Efficient Projection Method for Nonlinear Inverse Problems with Sparsity Constraints

Linear Convergence Results for Inertial Type Projection Algorithm for Quasi-Variational Inequalities

An Efficient Three-Term Conjugate Gradient Method for Nonlinear Monotone Equations with Convex Constraints

A MODIFIED SPECTRAL CONJUGATE GRADIENT PROJECTION METHOD FOR SOLVING NONLINEAR MONOTONE SYMMETRIC EQUATIONS

A Spectral Conjugate Gradient Method for Nonlinear Inverse Problems

A Conjugate Projection Gradient Algorithm for Nonlinear Constrained Optimization

A diagonal PRP-type projection method for convex constrained nonlinear monotone equations

A Revised Conjugate Gradient Projection Algorithm for Inequality Constrained Optimizations

A modified inertial three-term conjugate gradient method for nonsmooth convex optimization and its application

An improved Dai‐Liao‐style hybrid conjugate gradient‐based method for solving unconstrained nonconvex optimization and extension to constrained nonlinear monotone equations

A Derivative-Free Three-Term Projection Algorithm Involving Spectral Quotient for Solving Nonlinear Monotone Equations

Two Self-Adaptive Derivative-Free Methods with Restart Procedure for Constrained Nonlinear Equations with Applications