Abstract:A fast descent algorithm, resorting to a “stretching” function technique and built on one hybrid method (GRSA) which combines simulated annealing (SA) algorithm and gradient based methods for large scale global optimizations, is proposed. Unlike the previously proposed method in which the original objective functions remain unchanged during the whole course of optimization, the new method firstly constructs an auxiliary function on one local minimizer obtained by gradient based methods and then SA is executed on this constructed auxiliary function instead of on the original objective function in order that we can improve the jumping ability of SA algorithm to escape from the currently discovered local minimum to a better one from which the gradient based methods restart a new local search. The above procedure is repeated until a global minimum is detected. In addition, corresponding to the adopted “stretching” technique, a new next trial point generating scheme is designed. It is verified by simulation especially on large scale problems that the convergence speed is greatly accelerated, which is its main difference from many other reported methods that mostly cope with functions with less than 50 variables and does not apply to large scale optimization problems. Furthermore, the new algorithm functions as a global optimization procedure with a high success probability and high solution precision.

A Sequential Descent Method for Global Optimization

Super Gradient Descent: Global Optimization requires Global Gradient

A descent subgradient method using Mifflin line search for nonsmooth nonconvex optimization

Continuation Newton methods with deflation techniques for global optimization problems

A descent subgradient method using Mifflin's line search for nonsmooth nonconvex optimization

A Conjugate Gradient Method with Descent Direction for Unconstrained Optimization

Study on Two-Stage Fractional Order Gradient Descend Method

An Efficient Algorithm for Large Scale Global Optimization of Continuous Functions

Descent three-term conjugate gradient methods based on secant conditions for unconstrained optimization

The q-gradient method for global optimization

A Descent Method for Nonsmooth Multiobjective Optimization in Hilbert Spaces

A self-scaling memoryless BFGS based conjugate gradient method using multi-step secant condition for unconstrained minimization

Derivative-Free Global Minimization in One Dimension: Relaxation, Monte Carlo, and Sampling

A hybrid fast descent method for globally optimizing high dimensional functions

A family of three-term conjugate gradient methods with sufficient descent property for unconstrained optimization

Globally Convergent Three-Term Conjugate Gradient Methods that Use Secant Conditions and Generate Descent Search Directions for Unconstrained Optimization

Descent Methods for Vector Optimization Problems: A Majorization-Minimization Perspective

New Two - Point Stepsize Gradient Methods for Solving Unconstrained Optimization Problems

Modified Conjugate Gradient Method with Global Convergence Property