Abstract:Evolutionary algorithms, such as Differential Evolution, excel in solving real-parameter optimization challenges. However, the effectiveness of a single algorithm varies across different problem instances, necessitating considerable efforts in algorithm selection or configuration. This paper aims to address the limitation by leveraging the complementary strengths of a group of algorithms and dynamically scheduling them throughout the optimization progress for specific problems. We propose a deep reinforcement learning-based dynamic algorithm selection framework to accomplish this task. Our approach models the dynamic algorithm selection a Markov Decision Process, training an agent in a policy gradient manner to select the most suitable algorithm according to the features observed during the optimization process. To empower the agent with the necessary information, our framework incorporates a thoughtful design of landscape and algorithmic features. Meanwhile, we employ a sophisticated deep neural network model to infer the optimal action, ensuring informed algorithm selections. Additionally, an algorithm context restoration mechanism is embedded to facilitate smooth switching among different algorithms. These mechanisms together enable our framework to seamlessly select and switch algorithms in a dynamic online fashion. Notably, the proposed framework is simple and generic, offering potential improvements across a broad spectrum of evolutionary algorithms. As a proof-of-principle study, we apply this framework to a group of Differential Evolution algorithms. The experimental results showcase the remarkable effectiveness of the proposed framework, not only enhancing the overall optimization performance but also demonstrating favorable generalization ability across different problem classes.

Deep Reinforcement Learning Based Adaptive Environmental Selection for Evolutionary Multi-Objective Optimization.

Constrained Multi-Objective Optimization With Deep Reinforcement Learning Assisted Operator Selection

A reinforcement learning approach for dynamic multi-objective optimization

Adaptive Memetic Computing for Evolutionary Multiobjective Optimization

A note on the factor structure of the Devereux Child Behavior Rating Scale

Multi-Objective Neural Evolutionary Algorithm for Combinatorial Optimization Problems

A Self-Adaptive Response Strategy for Dynamic Multiobjective Evolutionary Optimization Based on Objective Space Decomposition

Adaptive operator selection with dueling deep Q-network for evolutionary multi-objective optimization

An Evolutionary Many-Objective Algorithm Based on a Novel Tournament Selection Strategy

Deep multi-layer perceptron-based evolutionary algorithm for dynamic multiobjective optimization

A Multi-Objective Evolutionary Algorithm With Hierarchical Clustering-Based Selection

Deep Reinforcement Learning for Dynamic Algorithm Selection: A Proof-of-Principle Study on Differential Evolution

An efficient evolutionary algorithm based on deep reinforcement learning for large-scale sparse multiobjective optimization

An Effective and Efficient Evolutionary Algorithm for Many-Objective Optimization

A Kriging-Assisted Evolutionary Algorithm with Two-Stage Environmental Selection Strategy for Expensive Multimodal Multi-Objective Optimization

Learning to Accelerate Evolutionary Search for Large-Scale Multiobjective Optimization

Machine Learning Assisted Evolutionary Multi-Objective Optimization [Guest Editorial]

Hybridization of evolutionary algorithm and deep reinforcement learning for multi-objective orienteering optimization

Evolutionary Algorithm with Dynamic Population Size for Constrained Multiobjective Optimization

Environment Sensitivity-Based Cooperative Co-Evolutionary Algorithms for Dynamic Multi-Objective Optimization

Multiobjective Evolution Strategy for Dynamic Multiobjective Optimization