ALMol: Aligned Language-Molecule Translation LLMs through Offline Preference Contrastive Optimisation

Dimitris Gkoumas

2024-07-15

Abstract:The field of chemistry and Artificial Intelligence (AI) intersection is an area of active research that aims to accelerate scientific discovery. The integration of large language models (LLMs) with scientific modalities has shown significant promise in this endeavour. However, challenges persist in effectively addressing training efficacy and the out-of-distribution problem, particularly as existing approaches rely on larger models and datasets. In this context, we focus on machine language-molecule translation and deploy a novel training approach called contrastive preference optimisation, which avoids generating translations that are merely adequate but not perfect. To ensure generalisability and mitigate memorisation effects, we conduct experiments using only 10% of the data. Our results demonstrate that our models achieve up to a 32% improvement compared to counterpart models. Finally, we introduce a fine-grained, domain-agnostic evaluation method to assess hallucination in LLMs and promote responsible use.

Computation and Language,Multimedia

What problem does this paper attempt to address?

The paper primarily aims to address two key issues at the intersection of chemistry and artificial intelligence:

1. **Training Efficiency Issue**: Current methods often rely on larger models and datasets to improve performance, but this approach does not necessarily guarantee better results. Therefore, researchers need to find a more efficient way to train models so that they perform well even on smaller datasets.

2. **Out-of-Distribution (OOD) Issue**: Existing methods perform poorly when handling new data that is not within the distribution range of the training data. The paper aims to improve the model's generalization ability to unseen data by proposing new training strategies.

To address the above issues, the authors propose a new training method—Contrastive Preference Optimisation (CTO), which is a training strategy based on offline preference data. This method can avoid generating translations that are merely "good enough" rather than "perfect." By conducting experiments using only 10% of the training data and employing this new training method, the models in the paper achieved significant improvements over the control models on multiple evaluation metrics, with performance gains of up to 32%. Additionally, the authors introduce a fine-grained, domain-agnostic evaluation method to detect hallucinations in the content generated by large language models (LLMs), ensuring the accuracy and consistency of the generated content.