Abstract:Evolutionary algorithms (EA), a class of stochastic search methods based on the principles of natural evolution, have received widespread acclaim for their exceptional performance in various real-world optimization problems. While researchers worldwide have proposed a wide variety of EAs, certain limitations remain, such as slow convergence speed and poor generalization capabilities. Consequently, numerous scholars actively explore improvements to algorithmic structures, operators, search patterns, etc., to enhance their optimization performance. Reinforcement learning (RL) integrated as a component in the EA framework has demonstrated superior performance in recent years. This paper presents a comprehensive survey on integrating reinforcement learning into the evolutionary algorithm, referred to as reinforcement learning-assisted evolutionary algorithm (RL-EA). We begin with the conceptual outlines of reinforcement learning and the evolutionary algorithm. We then provide a taxonomy of RL-EA. Subsequently, we discuss the RL-EA integration method, the RL-assisted strategy adopted by RL-EA, and its applications according to the existing literature. The RL-assisted procedure is divided according to the implemented functions including solution generation, learnable objective function, algorithm/operator/sub-population selection, parameter adaptation, and other strategies. Additionally, different attribute settings of RL in RL-EA are discussed. In the applications of RL-EA section, we also demonstrate the excellent performance of RL-EA on several benchmarks and a range of public datasets to facilitate a quick comparative study. Finally, we analyze potential directions for future research.

Automated Design of Search Algorithms Based on Reinforcement Learning.

Automated Design of Metaheuristics Using Reinforcement Learning Within a Novel General Search Framework

Automated Algorithm Design Using Proximal Policy Optimisation with Identified Features

Automated Design of Search Algorithms: Learning on Algorithmic Components.

Automated Metaheuristic Algorithm Design with Autoregressive Learning

Automated Design of Metaheuristic Algorithms: A Survey

Understanding the Importance of Evolutionary Search in Automated Heuristic Design with Large Language Models

Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language Model

Reinforcement Learning-assisted Evolutionary Algorithm: A Survey and Research Opportunities

An Adaptive Real Coded Population-Based Incremental Learning Algorithm for Design Optimizations in Continuous Space

Reinforcement Learning Informed Evolutionary Search for Autonomous Systems Testing

Learning search algorithm: framework and comprehensive performance for solving optimization problems

A novelty-search-based evolutionary reinforcement learning algorithm for continuous optimization problems

An Evolutionary Search Paradigm That Learns with Past Experiences

A novel reinforcement learning-inspired tunicate swarm algorithm for solving global optimization and engineering design problems

A Deep Reinforcement Learning-Based Adaptive Search for Solving Time-Dependent Green Vehicle Routing Problem

Auto-configuring Exploration-Exploitation Tradeoff in Evolutionary Computation via Deep Reinforcement Learning

Rotated Neighbor Learning-Based Auto-Configured Evolutionary Algorithm

Reinforcement Learning for Engineering Design Automation