Abstract:The design of functional transition metal complexes (TMCs) is hindered by the combinatorial explosion of the search space spanned by various metals and ligands, necessitating efficient multi- objective optimization strategies. Traditional genetic algorithms (GAs) are frequently employed in this domain, utilizing random mutations and crossovers steered by explicit mathematical objective formulations to navigate the search space. The transfer and sharing of knowledge across different GA optimization tasks, however, remain challenging. Here, we introduce the integration of large language models (LLMs) into the evolutionary optimization framework (LLM-EO) for TMCs. LLM- EO significantly outperforms traditional GAs due to the intrinsic chemical knowledge embedded within LLMs, acquired during their extensive pretraining. Notably, without the need for supervised fine-tuning, LLMs can leverage the entirety of historical data amassed during the optimization processes, demonstrating superior performance compared to LLMs that are limited to the best TMCs identified in the evolutionary cycle. Specifically, LLM-EO identifies eight out of the top 20 TMCs with the largest HOMO-LUMO gaps by interrogating merely 200 candidates within a vast search space of 1.37 million TMCs. Through prompt engineering using natural language, LLM-EO introduces unparalleled flexibility in multi-objective optimizations, especially when guided by seasoned researchers, thereby circumventing the necessity for intricate mathematical formulations. As generative models, LLMs possess the capability to propose novel ligands and TMCs with unique chemical properties by amalgamating both internal knowledge and external chemistry data, thus combining the benefits of efficient optimization and molecular generation. With the increasing potential of LLMs, both in their capacity as pretrained foundational models and new strategies in post-training inference, we anticipate broad applications of LLM-based evolutionary optimization in the fields of chemistry and materials design.

Towards Objective-Tailored Genetic Improvement Through Large Language Models

Enhancing Genetic Improvement Mutations Using Large Language Models

Evolving Code with A Large Language Model

Large Language Models As Evolution Strategies

Genomic Language Models: Opportunities and Challenges

Controlling the Mutation in Large Language Models for the Efficient Evolution of Algorithms

Exploring the Improvement of Evolutionary Computation via Large Language Models

Large Language Model-Based Evolutionary Optimizer: Reasoning with elitism

Large Language Model Aided Multi-objective Evolutionary Algorithm: a Low-cost Adaptive Approach

Large Language Model-Aided Evolutionary Search for Constrained Multiobjective Optimization

An Exploratory Study on Using Large Language Models for Mutation Testing

An Evaluation of Large Language Models in Bioinformatics Research

Generative Design of Functional Metal Complexes Utilizing the Internal Knowledge of Large Language Models

How Can Large Language Models Help Humans in Design and Manufacturing?

Should AI Optimize Your Code? A Comparative Study of Current Large Language Models Versus Classical Optimizing Compilers

UICoder: Finetuning Large Language Models to Generate User Interface Code through Automated Feedback

Autonomous Multi-Objective Optimization Using Large Language Model

Synergizing Human Expertise and AI Efficiency with Language Model for Microscopy Operation and Automated Experiment Design

InstOptima: Evolutionary Multi-objective Instruction Optimization via Large Language Model-based Instruction Operators