Abstract:Evolutionary algorithms and other meta-heuristics have been employed widely to solve optimization problems in many different fields over the past few decades. Their performance in finding optimal solutions often depends heavily on the parameterization of the algorithm's search operators, which affect an algorithm's balance between search diversification and intensification. While many parameter-adaptive algorithms have been developed to improve the searching ability of meta-heuristics, their performance is often unsatisfactory when applied to real-world problems. This is, at least in part, because available computational budgets are often constrained in such settings due to the long simulation times associated with objective function and/or constraint evaluation, thereby preventing convergence of existing parameter-adaptive algorithms. To this end, this paper proposes an innovative parameter-adaptive strategy for ant colony optimization (ACO) algorithms based on controlling the convergence trajectory in decision space to follow any prespecified path, aimed at finding the best possible solution within a given, and limited, computational budget. The utility of the proposed convergencetrajectory controlled ACO (ACO(CTC)) algorithm is demonstrated using six water distribution system design problems (WDSDPs, a difficult type of combinatorial problem in water resources) with varying complexity. The results show that the proposed ACO(CTC) successfully enables the specified convergence trajectories to be followed by automatically adjusting the algorithm's parameter values. Different convergence trajectories significantly affect the algorithm's final performance (solution quality). The trajectory with a slight bias toward diversification in the first half and more emphasis on intensification during the second half of the search exhibits substantially improved performance compared to the best available ACO variant with the best parameterization (no convergence control) for allWDSDPs and computational scenarios considered. For the two large-scale WDSDPs, new best-known solutions are found by the proposed ACO(CTC).

Utilitarian Algorithm Configuration for Infinite Parameter Spaces

Utilitarian Algorithm Configuration for Infinite Parameter Spaces

Sequential Model-Based Optimization for General Algorithm Configuration

The Algorithm Configuration Problem

A Genetic Algorithm Used in Multiple Parameters Optimization Problems with Constraints

An Adaptive Convergence-Trajectory Controlled Ant Colony Optimization Algorithm with Application to Water Distribution System Design Problems

Combining sequential model-based algorithm configuration with default-guided probabilistic sampling

Automated Algorithm Configuration and Parameter Tuning

Learning to Optimize Computational Resources: Frugal Training with Generalization Guarantees

Procrastinating with Confidence: Near-Optimal, Anytime, Adaptive Algorithm Configuration

Efficient Benchmarking of Algorithm Configuration Procedures via Model-Based Surrogates

Using Automated Algorithm Configuration for Parameter Control

Refined bounds for algorithm configuration: The knife-edge of dual class approximability

Multi-granularity Competition-Cooperation Optimization Algorithm with Adaptive Parameter Configuration

Automated Configuration of Genetic Algorithms by Tuning for Anytime Performance

Concept, Principle and Application of Dynamic Configuration for Intelligent Algorithms

Efficient Hyperparameter Optimization for Deep Learning Algorithms Using Deterministic RBF Surrogates

Efficient Hyperparameter Optimization of Deep Learning Algorithms Using Deterministic RBF Surrogates

Artificial Intelligence Applied to Assistive Technologies and Smart Environments, Papers from the 2016 AAAI Workshop, Phoenix, Arizona, USA, February 12, 2016

Auptimizer -- an Extensible, Open-Source Framework for Hyperparameter Tuning

A Bayesian Discrete Optimization Algorithm for Permutation Based Combinatorial Problems