Abstract:Despite significant empirical and theoretically supported evidence that non-static parameter choices can be strongly beneficial in evolutionary computation, the question how to best adjust parameter values plays only a marginal role in contemporary research on discrete black-box optimization. This has led to the unsatisfactory situation in which feedback-free parameter selection rules such as the cooling schedule of Simulated Annealing are predominant in state-of-the-art heuristics, while, at the same time, we understand very well that such time-dependent selection rules can not perform as well as adjustment rules that do take into account the evolution of the optimization process. A number of adaptive and self-adaptive parameter control strategies have been proposed in the literature, but did not (yet) make their way to a broader public. A key obstacle seems to lie in their rather complex update rules. The purpose of our work is to demonstrate that high-performing online parameter selection rules do not have to be very complicated. More precisely, we experiment with a multiplicative, comparison-based update rule to adjust the mutation rate of a (1+1) Evolutionary Algorithm. We show that this simple self-adjusting rule outperforms the best static unary unbiased black-box algorithm on LeadingOnes, achieving an almost optimal speedup of about 18%. We also observe promising performance on the OneMax benchmark problem.

KW-Race and Fast KW-Race: Racing-Based Frameworks for Tuning Parameters of Evolutionary Algorithms on Black-Box Optimization Problems.

Fast Engineering Optimization: A Novel Highly Effective Control Parameterization Approach for Industrial Dynamic Processes

Novel Non-Uniform Adaptive Grid Refinement Control Parameterization Approach for Biochemical Processes Optimization

Combining Meta-Eas and Racing for Difficult Ea Parameter Tuning Tasks

A Hybrid Approach To Parameter Tuning In Genetic Algorithms

Random sampling-based automatic parameter tuning for nonlinear programming solvers

Simple on-the-fly parameter selection mechanisms for two classical discrete black-box optimization benchmark problems

Parallel computing based parameter auto-tuning algorithm for optimization solvers

On the Effectiveness of Simple Success-Based Parameter Selection Mechanisms for Two Classical Discrete Black-Box Optimization Benchmark Problems

A Framework for Self-Tuning Optimization Algorithm

Automated Configuration of Genetic Algorithms by Tuning for Anytime Performance

Statistical Racing Techniques for Improved Empirical Evaluation of Evolutionary Algorithms.

An Adaptive Parameter Tuning Strategy For Many-Objective Evolutionary Algorithm

A Trust-Region Framework for Real-Time Optimization with Structural Process-Model Mismatch

Fitness landscape-based parameter tuning method for evolutionary algorithms for computing unique input output sequences

Generalized Parameter Estimation Method for Model-Based Real Time Optimization

A guideline for parameter setting of an evolutionary algorithm using optimal latin hypercube design and statistical analysis

Parameter Tuning for Self-optimizing Software at Scale

Adaptive Parameter Tuning for Reachability Analysis of Linear Systems

On Hyper-parameter Tuning for Stochastic Optimization Algorithms

A Data-Driven Self-Adaptive Parameter Tuning Framework for Composite Automobile Part Optimization Design