Abstract:The global minimum point of an optimization problem is of interest in engineering fields and it is difficult to solve, especially for a nonconvex large-scale optimization problem. In this article, we consider a new memetic algorithm for this problem. That is to say, we use the continuation Newton method with the deflation technique to find multiple stationary points of the objective function and use those found stationary points as the initial seeds of the evolutionary algorithm, other than the random initial seeds of the known evolutionary algorithms. Meanwhile, in order to retain the usability of the derivative-free method and the fast convergence of the gradient-based method, we use the automatic differentiation technique to compute the gradient and replace the Hessian matrix with its finite difference approximation. According to our numerical experiments, this new algorithm works well for unconstrained optimization problems and finds their global minima efficiently, in comparison to the other representative global optimization methods such as the multi-start methods (the built-in subroutine GlobalSearch.m of MATLAB R2021b, GLODS, and VRBBO), the branch-and-bound method (Couenne, a state-of-the-art open-source solver for mixed integer nonlinear programming problems), and the derivative-free algorithms (CMA-ES and MCS).

A Conservation Law Method in Optimization

Gauss-Newton Methods for A Class of Nonsmooth Optimization Problems

Convergence of Inexact Steepest Descent Algorithm for Multiobjective Optimizations on Riemannian Manifolds Without Curvature Constraints

Convergence Analysis of Gradient Algorithms on Riemannian Manifolds Without Curvature Constraints and Application to Riemannian Mass

Local and Global Behavior for Algorithms of Solving Equations

A Newton-Like Dynamical System for Nonsmooth and Nonconvex Optimization

Continuation Newton methods with deflation techniques for global optimization problems

Fast inertial dynamic algorithm with smoothing method for nonsmooth convex optimization

Global Convergence of Langevin Dynamics Based Algorithms for Nonconvex Optimization

On the local convergence of the semismooth Newton method for composite optimization

A globally convergent proximal Newton-type method in nonsmooth convex optimization

Convergence Error Analysis of Reflected Gradient Langevin Dynamics for Globally Optimizing Non-Convex Constrained Problems

Constrained, Global Optimization of Functions with Lipschitz Continuous Gradients

A Newton-MR algorithm with complexity guarantees for nonconvex smooth unconstrained optimization

An Eulerian–Lagrangian Method for Optimization Problems Governed by Multidimensional Nonlinear Hyperbolic PDEs

Accelerated First-Order Optimization under Nonlinear Constraints

A Newton-CG based barrier-augmented Lagrangian method for general nonconvex conic optimization

A Local Nearly Linearly Convergent First-Order Method for Nonsmooth Functions with Quadratic Growth