Abstract:Solving constrained optimization problems (COPs) with evolutionary algorithms (EAs) is a popular research direction due to its potential and diverse applications. One of the key issues in solving COPs is the choice of constraint handling techniques (CHTs), as different CHTs can lead to different evolutionary directions. Combining EAs with deep reinforcement learning (DRL) is a promising and emerging approach for solving COPs. Although DRL can help solve the problem of pre-setting operators in EAs, neural networks need to obtain diverse training data within a limited number of evaluations in EAs. Based on the above considerations, this work proposes a DRL assisted co-evolutionary differential evolution, named CEDE-DRL, which can effectively use DRL to help EAs solve COPs. (1) This method incorporates co-evolution into the extraction of training data for the first time, ensuring the diversity of samples and improving the accuracy of the neural network model through information exchange between multiple populations. (2) Multiple CHTs are used for offspring selection to ensure the algorithm’s generality and flexibility. (3) DRL is used to evaluate the population state, taking into account feasibility, convergence, and diversity in the state setting and using the overall degree of improvement as a reward. The neural network selects suitable parent populations and corresponding archives for mutation. Finally, (4) to avoid premature convergence and local optima, an adaptive operator selection and individual archive elimination mechanism is added. Comparisons with state-of-the-art algorithms on benchmark functions CEC2010 and CEC2017 show that the proposed method performs competitively and produced robust solutions. The results of the application test set CEC2020 show that the proposed algorithm is also effective in real-world problems.

Adaptive Evolutionary Reinforcement Learning Algorithm with Early Termination Strategy.

Adaptive Evolutionary Reinforcement Learning with Policy Direction

ERL-TD: Evolutionary Reinforcement Learning Enhanced with Truncated Variance and Distillation Mutation

Two-Stage Evolutionary Reinforcement Learning for Enhancing Exploration and Exploitation

Evolution-Guided Policy Gradient in Reinforcement Learning

Maximum Entropy Reinforcement Learning with Evolution Strategies

Reinforcement Learning-assisted Evolutionary Algorithm: A Survey and Research Opportunities

A novelty-search-based evolutionary reinforcement learning algorithm for continuous optimization problems

Proximal Distilled Evolutionary Reinforcement Learning

ERL-Re$^2$: Efficient Evolutionary Reinforcement Learning with Shared State Representation and Individual Policy Representation

Evolutionary Reinforcement Learning: A Systematic Review and Future Directions

Bridging Evolutionary Algorithms and Reinforcement Learning: A Comprehensive Survey on Hybrid Algorithms

Efficient Reinforcement-Learning Control Algorithm Using Experience Reuse

BiERL: A Meta Evolutionary Reinforcement Learning Framework via Bilevel Optimization

Evolutionary Reinforcement Learning via Cooperative Coevolution

An Improved Evolutionary Reinforcement Learning Algorithm for UAV Online Target Tracking.

Deep Reinforcement Learning Assisted Co-Evolutionary Differential Evolution for Constrained Optimization.

Survival of the Fittest: Evolutionary Adaptation of Policies for Environmental Shifts

Reinforcement Learning Informed Evolutionary Search for Autonomous Systems Testing

Evolutionary Reinforcement Learning with Action Sequence Search for Imperfect Information Games

Evolutionary Reinforcement Learning: A Survey