Abstract:Selection hyper-heuristics (HHs) are randomised search methodologies which choose and execute heuristics during the optimisation process from a set of low-level heuristics. A machine learning mechanism is generally used to decide which low-level heuristic should be applied in each decision step. In this article, we analyse whether sophisticated learning mechanisms are always necessary for HHs to perform well. To this end we consider the most simple HHs from the literature and rigorously analyse their performance for the LeadingOnes benchmark function. Our analysis shows that the standard Simple Random, Permutation, Greedy, and Random Gradient HHs show no signs of learning. While the former HHs do not attempt to learn from the past performance of low-level heuristics, the idea behind the Random Gradient HH is to continue to exploit the currently selected heuristic as long as it is successful. Hence, it is embedded with a reinforcement learning mechanism with the shortest possible memory. However, the probability that a promising heuristic is successful in the next step is relatively low when perturbing a reasonable solution to a combinatorial optimisation problem. We generalise the "simple" Random Gradient HH so success can be measured over a fixed period of time τ, instead of a single iteration. For LeadingOnes we prove that the Generalised Random Gradient (GRG) HH can learn to adapt the neighbourhood size of Randomised Local Search to optimality during the run. As a result, we prove it has the best possible performance achievable with the low-level heuristics (Randomised Local Search with different neighbourhood sizes), up to lower-order terms. We also prove that the performance of the HH improves as the number of low-level local search heuristics to choose from increases. In particular, with access to k low-level local search heuristics, it outperforms the best-possible algorithm using any subset of the k heuristics. Finally, we show that the advantages of GRG over Randomised Local Search and Evolutionary Algorithms using standard bit mutation increase if the anytime performance is considered (i.e., the performance gap is larger if approximate solutions are sought rather than exact ones). Experimental analyses confirm these results for different problem sizes (up to n=108) and shed some light on the best choices for the parameter τ in various situations.

A Generality Analysis of Multiobjective Hyper-heuristics

Comparative Analysis of Selection Hyper-Heuristics for Real-World Multi-Objective Optimization Problems

Selection Hyper-heuristics Can Provably Be Helpful in Evolutionary Multi-objective Optimization

A New Hyper-Heuristic Multi-Objective Optimisation Approach Based on MOEA/D Framework

A compass-based hyper-heuristic for multi-objective optimization problems

Multi-objective Evolution of Heuristic Using Large Language Model

Hyper-heuristics: a survey of the state of the art

An Empirical Study of Meta- and Hyper-Heuristic Search for Multi-Objective Release Planning

Generalizable Meta-Heuristic based on Temporal Estimation of Rewards for Large Scale Blackbox Optimization

Hierarchy Ranking Method for Multimodal Multi-objective Optimization with Local Pareto Fronts

On the Performance of Metaheuristics: A Different Perspective

A dynamic multiarmed bandit-gene expression programming hyper-heuristic for combinatorial optimization problems

Hyperplane Assisted Evolutionary Algorithm for Many-Objective Optimization Problems.

Analysing hyper-heuristics based on Neural Networks for the automatic design of population-based metaheuristics in continuous optimisation problems

Simple Hyper-Heuristics Control the Neighbourhood Size of Randomised Local Search Optimally for LeadingOnes

A Hidden Markov Model Approach to the Problem of Heuristic Selection in Hyper-Heuristics with a Case Study in High School Timetabling Problems

Multiobjective Evolutionary Component Effect on Algorithm behavior

Multitask Genetic Programming-Based Generative Hyperheuristics: A Case Study in Dynamic Scheduling

Multi-objective evolution strategy for multimodal multi-objective optimization

Adaptive nested Monte Carlo approach for multi-objective efficient global optimization

A hypervolume distribution entropy guided computation resource allocation mechanism for the multiobjective evolutionary algorithm based on decomposition