Abstract:Multiobjective evolutionary algorithms (MOEAs) are major methods for solving multiobjective optimization problems (MOPs). Many MOEAs have been proposed in the past decades, of which the search operators need a carefully handcrafted design with domain knowledge. Recently, some attempts have been made to replace the manually designed operators in MOEAs with learning-based operators (e.g., neural network models). However, much effort is still required for designing and training such models, and the learned operators might not generalize well on new problems. To tackle the above challenges, this work investigates a novel approach that leverages the powerful large language model (LLM) to design MOEA operators. With proper prompt engineering, we successfully let a general LLM serve as a black-box search operator for decomposition-based MOEA (MOEA/D) in a zero-shot manner. In addition, by learning from the LLM behavior, we further design an explicit white-box operator with randomness and propose a new version of decomposition-based MOEA, termed MOEA/D-LO. Experimental studies on different test benchmarks show that our proposed method can achieve competitive performance with widely used MOEAs. It is also promising to see the operator only learned from a few instances can have robust generalization performance on unseen problems with quite different patterns and settings. The results reveal the potential benefits of using pre-trained LLMs in the design of <a class="link-external link-http" href="http://MOEAs.To" rel="external noopener nofollow">this http URL</a> foster reproducibility and accessibility, the source code is <a class="link-external link-https" href="https://github.com/FeiLiu36/LLM4MOEA" rel="external noopener nofollow">this https URL</a>.

COIL: Constrained Optimization in Learned Latent Space: Learning Representations for Valid Solutions

Advancing Bayesian Optimization via Learning Correlated Latent Space

Using a Variational Autoencoder to Learn Valid Search Spaces of Safely Monitored Autonomous Robots for Last-Mile Delivery

GenCO: Generating Diverse Designs with Combinatorial Constraints

Latent Space Bayesian Optimization with Latent Data Augmentation for Enhanced Exploration

Learning to Solve Combinatorial Optimization under Positive Linear Constraints via Non-Autoregressive Neural Networks

Model-Based Reinforcement Learning via Latent-Space Collocation

Relaxed Combinatorial Optimization Networks with Self-Supervision: Theoretical and Empirical Notes on the Cardinality-Constrained Case

Local Latent Space Bayesian Optimization over Structured Inputs

Joint Composite Latent Space Bayesian Optimization

Tackling Prevalent Conditions in Unsupervised Combinatorial Optimization: Cardinality, Minimum, Covering, and More

ScaLES: Scalable Latent Exploration Score for Pre-Trained Generative Networks

Multi-Objective Latent Space Optimization of Generative Molecular Design Models

Dynamic Narrowing of VAE Bottlenecks Using GECO and L0 Regularization

Large Language Models for Combinatorial Optimization of Design Structure Matrix

Learning Constrained Optimization with Deep Augmented Lagrangian Methods

CoLiDE: Concomitant Linear DAG Estimation

Learning for Robust Combinatorial Optimization: Algorithm and Application

COOL: Efficient and Reliable Chain-Oriented Objective Logic with Neural Networks Feedback Control for Program Synthesis

Large Language Model for Multi-objective Evolutionary Optimization