Abstract:Evolutionary algorithms and other meta-heuristics have been employed widely to solve optimization problems in many different fields over the past few decades. Their performance in finding optimal solutions often depends heavily on the parameterization of the algorithm's search operators, which affect an algorithm's balance between search diversification and intensification. While many parameter-adaptive algorithms have been developed to improve the searching ability of meta-heuristics, their performance is often unsatisfactory when applied to real-world problems. This is, at least in part, because available computational budgets are often constrained in such settings due to the long simulation times associated with objective function and/or constraint evaluation, thereby preventing convergence of existing parameter-adaptive algorithms. To this end, this paper proposes an innovative parameter-adaptive strategy for ant colony optimization (ACO) algorithms based on controlling the convergence trajectory in decision space to follow any prespecified path, aimed at finding the best possible solution within a given, and limited, computational budget. The utility of the proposed convergencetrajectory controlled ACO (ACO(CTC)) algorithm is demonstrated using six water distribution system design problems (WDSDPs, a difficult type of combinatorial problem in water resources) with varying complexity. The results show that the proposed ACO(CTC) successfully enables the specified convergence trajectories to be followed by automatically adjusting the algorithm's parameter values. Different convergence trajectories significantly affect the algorithm's final performance (solution quality). The trajectory with a slight bias toward diversification in the first half and more emphasis on intensification during the second half of the search exhibits substantially improved performance compared to the best available ACO variant with the best parameterization (no convergence control) for allWDSDPs and computational scenarios considered. For the two large-scale WDSDPs, new best-known solutions are found by the proposed ACO(CTC).

Out-of-the-box parameter control for evolutionary and swarm-based algorithms with distributed reinforcement learning

Parameter Control Framework for Multiobjective Evolutionary Computation Based on Deep Reinforcement Learning

An Adaptive Convergence-Trajectory Controlled Ant Colony Optimization Algorithm with Application to Water Distribution System Design Problems

Autonomous Parameter Balance in Population-Based Approaches: A Self-Adaptive Learning-Based Strategy

Adaptive Online Data-Driven Closed-Loop Parameter Control Strategy for Swarm Intelligence Algorithm

An Adaptive Online Parameter Control Algorithm For Particle Swarm Optimization Based On Reinforcement Learning

Reinforcement learning based adaptive metaheuristics

A Self-Adaptive Parameter Control Method Based on Entropy and Security Market Line for Scheduling Problems

Parameter Evolution For A Particle Swarm Optimization Algorithm

Simple on-the-fly parameter selection mechanisms for two classical discrete black-box optimization benchmark problems

Learning Adaptive Differential Evolution Algorithm from Optimization Experiences by Policy Gradient

Variational Reinforcement Learning for Hyper-Parameter Tuning of Adaptive Evolutionary Algorithm

A Multi-Objective Optimization Method for Intelligent Swarm Robotic Control Model with Changeable Parameters

Multiple Parameter Control for Ant Colony Optimization Applied to Feature Selection Problem

On Hyper-parameter Tuning for Stochastic Optimization Algorithms

Parameter Optimization Via Reinforcement Learning for the Regulation of Swarms

Towards Autonomous Reinforcement Learning: Automatic Setting of Hyper-parameters using Bayesian Optimization

Self-Adaptive Parameter Control in Genetic Algorithms Based on Entropy and Rules of Nature for Combinatorial Optimization Problems

A survey of dynamic parameter setting methods for nature-inspired swarm intelligence algorithms

Using Automated Algorithm Configuration for Parameter Control

Metacontrol for Adaptive Imagination-Based Optimization