Look-ahead natural evolutionary strategies

Jin Liang Jia,Alfredo Alan Flores Saldivar,Lin Li,Yun Li
DOI: https://doi.org/10.1145/3377929.3389998
2020-01-01
Abstract:Natural1 evolution strategy (NES) algorithms have seen a variety of successful applications recently, but still need to improve algorithmic convergence. To address this issue, we propose the use of a look-ahead scheme predictively to estimate the natural acceleration in the algorithm. This estimation is to assist convergence towards the global optimum faster. The resultant algorithm is termed a "Look-Ahead Natural Evolutionary Strategy" (LANES) algorithm. It is tested against a combination of multiple benchmarks using a number of well-known benchmark problems. Compared with the original NES, the LANES increases the optimizer overheads, but offers a steady improvement in optimality, accuracy, and convergence.
What problem does this paper attempt to address?