Abstract:The global minimum point of an optimization problem is of interest in engineering fields and it is difficult to solve, especially for a nonconvex large-scale optimization problem. In this article, we consider a new memetic algorithm for this problem. That is to say, we use the continuation Newton method with the deflation technique to find multiple stationary points of the objective function and use those found stationary points as the initial seeds of the evolutionary algorithm, other than the random initial seeds of the known evolutionary algorithms. Meanwhile, in order to retain the usability of the derivative-free method and the fast convergence of the gradient-based method, we use the automatic differentiation technique to compute the gradient and replace the Hessian matrix with its finite difference approximation. According to our numerical experiments, this new algorithm works well for unconstrained optimization problems and finds their global minima efficiently, in comparison to the other representative global optimization methods such as the multi-start methods (the built-in subroutine GlobalSearch.m of MATLAB R2021b, GLODS, and VRBBO), the branch-and-bound method (Couenne, a state-of-the-art open-source solver for mixed integer nonlinear programming problems), and the derivative-free algorithms (CMA-ES and MCS).

A New Continuation Newton-like Method and Its Deformation

Newton-like method with some remarks

A Significant Improvement On Newton'S Iterative Method

Note on the Improvement of Newton’s Method for System of Nonlinear Equations

A significant improvement on Newton's interative method

Continuous Newton Method for Nonlinear Partial Differential Equation

New high-order convergence iteration methods without employing derivatives for solving nonlinear equations

Newton's Method for Sections on Riemannian Manifolds: Generalized Covariant Α-Theory

Extended Newton Methods for Conic Inequalities: Approximate Solutions and the Extended Smale Α-Theory

Some Substantial Modifications and Improvements for Derivative-Free Iterative Methods and Derivative-Free Transformation for Multiple Zeros

Continuation Newton methods with deflation techniques for global optimization problems

Convergence Criterion of Newton's Method for Singular Systems with Constant Rank Derivatives

Newton Type Methods for Solving Nonsmooth Equations

Local Convergence of Inexact Methods under the Hölder Condition

Convergence of Newton'S Method for Systems of Equations with Constant Rank Derivatives

A generic and efficient Taylor series–based continuation method using a quadratic recast of smooth nonlinear systems

On Convergence Of A New Secant-Like Method For Solving Nonlinear Equations

A New Semi-Local Convergence Theorem for the Inexact Newton Methods

Arc-Length Continuation Algorithm for Nonlinear Finite Element Equations

A semi-local convergence theorem for a robust revised Newton's method