Abstract:Large Language Models (LLMs) have not only revolutionized natural language processing but also extended their prowess to various domains, marking a significant stride towards artificial general intelligence. The interplay between LLMs and Evolutionary Algorithms (EAs), despite differing in objectives and methodologies, share a common pursuit of applicability in complex problems. Meanwhile, EA can provide an optimization framework for LLM's further enhancement under black-box settings, empowering LLM with flexible global search capacities. On the other hand, the abundant domain knowledge inherent in LLMs could enable EA to conduct more intelligent searches. Furthermore, the text processing and generative capabilities of LLMs would aid in deploying EAs across a wide range of tasks. Based on these complementary advantages, this paper provides a thorough review and a forward-looking roadmap, categorizing the reciprocal inspiration into two main avenues: LLM-enhanced EA and EA-enhanced LLM. Some integrated synergy methods are further introduced to exemplify the amalgamation of LLMs and EAs in diverse scenarios, including neural architecture search, code generation, software engineering, and various generation tasks. As the first comprehensive review focused on the EA research in the era of LLMs, this paper provides a foundational stepping stone for understanding the collaborative potential of LLMs and EAs. By meticulous categorization and critical analysis, we contribute to the ongoing discourse on the cross-disciplinary study of these two powerful paradigms. The identified challenges and future directions offer guidance for researchers and practitioners aiming to unlock the full potential of this innovative collaboration in propelling advancements in optimization and artificial intelligence.

The Rise and Design of Enterprise Large Language Models

Large Language Models and Knowledge Graphs: Opportunities and Challenges

Large Language Models and Applications: The Rebirth of Enterprise Knowledge Management and the Rise of Prompt Libraries

Exploring the landscape of large language models: Foundations, techniques, and challenges

Large language models and academic writing: Five tiers of engagement

Large Language Models: A Survey

Large Language Models: The Need for Nuance in Current Debates and a Pragmatic Perspective on Understanding

Engineering Exploration and Research on Large Language Models

Challenges and Applications of Large Language Models

Large Language Models and Generative AI, Oh My!

The Importance of Understanding Language in Large Language Models

LARGE LANGUAGE MODEL-BASED ARTIFICIAL INTELLIGENCE IN THE LANGUAGE CLASSROOM: PRACTICAL IDEAS FOR TEACHING

Eight Things to Know about Large Language Models

Multilingual Large Language Models and Curse of Multilinguality

Evolutionary Computation in the Era of Large Language Model: Survey and Roadmap

An analysis of large language models: their impact and potential applications

Unlocking the potential: A comprehensive exploration of large language models in natural language processing

Large Models of What? Mistaking Engineering Achievements for Human Linguistic Agency

Large Linguistic Models: Analyzing theoretical linguistic abilities of LLMs

Large Language Model Supply Chain: A Research Agenda

Large Language Models for Education: A Survey and Outlook