Abstract:Evolutionary algorithms, such as Differential Evolution, excel in solving real-parameter optimization challenges. However, the effectiveness of a single algorithm varies across different problem instances, necessitating considerable efforts in algorithm selection or configuration. This paper aims to address the limitation by leveraging the complementary strengths of a group of algorithms and dynamically scheduling them throughout the optimization progress for specific problems. We propose a deep reinforcement learning-based dynamic algorithm selection framework to accomplish this task. Our approach models the dynamic algorithm selection a Markov Decision Process, training an agent in a policy gradient manner to select the most suitable algorithm according to the features observed during the optimization process. To empower the agent with the necessary information, our framework incorporates a thoughtful design of landscape and algorithmic features. Meanwhile, we employ a sophisticated deep neural network model to infer the optimal action, ensuring informed algorithm selections. Additionally, an algorithm context restoration mechanism is embedded to facilitate smooth switching among different algorithms. These mechanisms together enable our framework to seamlessly select and switch algorithms in a dynamic online fashion. Notably, the proposed framework is simple and generic, offering potential improvements across a broad spectrum of evolutionary algorithms. As a proof-of-principle study, we apply this framework to a group of Differential Evolution algorithms. The experimental results showcase the remarkable effectiveness of the proposed framework, not only enhancing the overall optimization performance but also demonstrating favorable generalization ability across different problem classes.

Sequential Learnable Evolutionary Algorithm: A Research Program

An Adaptive Real Coded Population-Based Incremental Learning Algorithm for Design Optimizations in Continuous Space

Learning to Learn Evolutionary Algorithm: A Learnable Differential Evolution

Love Evolution Algorithm: a stimulus–value–role theory-inspired evolutionary algorithm for global optimization

Evolutionary Learning: Advances in Theories and Algorithms

Deep Reinforcement Learning for Dynamic Algorithm Selection: A Proof-of-Principle Study on Differential Evolution

An Ensemble Algorithm with Self-Adaptive Learning Techniques for High-Dimensional Numerical Optimization

Controlling Sequential Hybrid Evolutionary Algorithm by Q-Learning [research Frontier] [research Frontier]

Shuffled multi-evolutionary algorithm with linear population size reduction

A Novel Evolutionary Algorithm Ensemble for Global Numerical Optimization.

An Evolutionary Frog Leaping Algorithm for Global Optimization Problems and Applications

An Adaptive Multiform Evolutionary Algorithm for Global Continuous Optimization.

Learning search algorithm: framework and comprehensive performance for solving optimization problems

Reinforcement Learning-assisted Evolutionary Algorithm: A Survey and Research Opportunities

From the Social Learning Theory to a Social Learning Algorithm for Global Optimization

Serial Multilevel-Learned Differential Evolution with Adaptive Guidance of Exploration and Exploitation

A New Evolutionary Algorithm For A Class Of Nonlinear Bilevel Programming Problems And Its Global Convergence

A Q-learning Based Evolutionary Algorithm for Sequential Decision Making Problems

A Survey on Algorithm Adaptation in Evolutionary Computation

Research on SAA-based New Hybrid Evolutionary Algorithm and Its Application

An Evolutionary Search Paradigm That Learns with Past Experiences