Abstract:The global minimum point of an optimization problem is of interest in engineering fields and it is difficult to solve, especially for a nonconvex large-scale optimization problem. In this article, we consider a new memetic algorithm for this problem. That is to say, we use the continuation Newton method with the deflation technique to find multiple stationary points of the objective function and use those found stationary points as the initial seeds of the evolutionary algorithm, other than the random initial seeds of the known evolutionary algorithms. Meanwhile, in order to retain the usability of the derivative-free method and the fast convergence of the gradient-based method, we use the automatic differentiation technique to compute the gradient and replace the Hessian matrix with its finite difference approximation. According to our numerical experiments, this new algorithm works well for unconstrained optimization problems and finds their global minima efficiently, in comparison to the other representative global optimization methods such as the multi-start methods (the built-in subroutine GlobalSearch.m of MATLAB R2021b, GLODS, and VRBBO), the branch-and-bound method (Couenne, a state-of-the-art open-source solver for mixed integer nonlinear programming problems), and the derivative-free algorithms (CMA-ES and MCS).

Two Self-Adaptive Derivative-Free Methods with Restart Procedure for Constrained Nonlinear Equations with Applications

A conjugate gradient projection method with restart procedure for solving constraint equations and image restorations

A family of three-term conjugate gradient projection methods with a restart procedure and their relaxed-inertial extensions for the constrained nonlinear pseudo-monotone equations with applications

A derivative-free memoryless BFGS hyperplane projection method for solving large-scale nonlinear monotone equations

An improved Dai‐Liao‐style hybrid conjugate gradient‐based method for solving unconstrained nonconvex optimization and extension to constrained nonlinear monotone equations

Two Descent Dai-Yuan Conjugate Gradient Methods for Systems of Monotone Nonlinear Equations

A hybrid three-term conjugate gradient projection method for constrained nonlinear monotone equations with applications

An inertial hybrid DFPM-based algorithm for constrained nonlinear equations with applications

Accelerated Gradient Methods with Gradient Restart: Global Linear Convergence

A New Hybrid Descent Algorithm for Large-Scale Nonconvex Optimization and Application to Some Image Restoration Problems

An inertial Fletcher–Reeves-type conjugate gradient projection-based method and its spectral extension for constrained nonlinear equations

A new approximate descent derivative-free algorithm for large-scale nonlinear symmetric equations

Hybrid Hu-Storey type methods for large-scale nonlinear monotone systems and signal recovery

New high-order convergence iteration methods without employing derivatives for solving nonlinear equations

A class of new three-term descent conjugate gradient algorithms for large-scale unconstrained optimization and applications to image restoration problems

A Modified Three-Term Conjugate Descent Derivative-Free Method for Constrained Nonlinear Monotone Equations and Signal Reconstruction Problems

Restart of accelerated first order methods with linear convergence under a quadratic functional growth condition

An Efficient Modified Residual-Based Algorithm for Large Scale Symmetric Nonlinear Equations by Approximating Successive Iterated Gradients

Two sufficient descent three-term conjugate gradient methods for unconstrained optimization problems with applications in compressive sensing

Continuation Method with the Trusty Time-stepping Scheme for Linearly Constrained Optimization with Noisy Data

Continuation Newton methods with deflation techniques for global optimization problems