Abstract:Molecule discovery plays a crucial role in various scientific fields, advancing the design of tailored materials and drugs. However, most of the existing methods heavily rely on domain experts, require excessive computational cost, or suffer from sub-optimal performance. On the other hand, Large Language Models (LLMs), like ChatGPT, have shown remarkable performance in various cross-modal tasks due to their powerful capabilities in natural language understanding, generalization, and in-context learning (ICL), which provides unprecedented opportunities to advance molecule discovery. Despite several previous works trying to apply LLMs in this task, the lack of domain-specific corpus and difficulties in training specialized LLMs still remain challenges. In this work, we propose a novel LLM-based framework (MolReGPT) for molecule-caption translation, where an In-Context Few-Shot Molecule Learning paradigm is introduced to empower molecule discovery with LLMs like ChatGPT to perform their in-context learning capability without domain-specific pre-training and fine-tuning. MolReGPT leverages the principle of molecular similarity to retrieve similar molecules and their text descriptions from a local database to enable LLMs to learn the task knowledge from context examples. We evaluate the effectiveness of MolReGPT on molecule-caption translation, including molecule understanding and text-based molecule generation. Experimental results show that compared to fine-tuned models, MolReGPT outperforms MolT5-base and is comparable to MolT5-large without additional training. To the best of our knowledge, MolReGPT is the first work to leverage LLMs via in-context learning in molecule-caption translation for advancing molecule discovery. Our work expands the scope of LLM applications, as well as providing a new paradigm for molecule discovery and design.

GIT-Mol: A multi-modal large language model for molecular science with graph, image, and text

GIT-Mol: A Multi-modal Large Language Model for Molecular Science with Graph, Image, and Text

The Future of Molecular Studies Through the Lens of Large Language Models.

Exploring the Potential of Large Language Models in Molecular Tasks: An Insightful Evaluation with GPT‐4

MolX: Enhancing Large Language Models for Molecular Learning with A Multi-Modal Extension

Large language model for molecular chemistry

Can Large Language Models Understand Molecules?

Empowering Molecule Discovery for Molecule-Caption Translation with Large Language Models: A ChatGPT Perspective

Molecular Graph Representation Learning Integrating Large Language Models with Domain-specific Small Models

MolLM : a unified language model for integrating biomedical text with 2D and 3D molecular representations

Instruction Multi-Constraint Molecular Generation Using a Teacher-Student Large Language Model

3D-MolT5: Towards Unified 3D Molecule-Text Modeling with 3D Molecular Tokenization

G2T-LLM: Graph-to-Tree Text Encoding for Molecule Generation with Fine-Tuned Large Language Models

MultiModal-Learning for Predicting Molecular Properties: A Framework Based on Image and Graph Structures

MolTC: Towards Molecular Relational Modeling In Language Models

Pretraining Graph Transformer for Molecular Representation with Fusion of Multimodal Information

Can Large Language Models Empower Molecular Property Prediction?

MolCA: Molecular Graph-Language Modeling with Cross-Modal Projector and Uni-Modal Adapter

MolScribe: Robust Molecular Structure Recognition with Image-To-Graph Generation

GPT-MolBERTa: GPT Molecular Features Language Model for molecular property prediction