Abstract:Organic synthesis stands as a cornerstone of chemical industry. The development of robust machine learning models to support tasks associated with organic reactions is of significant interest. However, current methods rely on hand-crafted features or direct adaptations of model architectures from other domains, which lacks feasibility as data scales increase or overlook the rich chemical information inherent in reactions. To address these issues, this paper introduces {\modelname}, a novel chemical reaction representation learning model tailored for a variety of organic-reaction-related tasks. By integrating atomic correspondence between reactants and products, our model discerns the molecular transformations that occur during the reaction, thereby enhancing the comprehension of the reaction mechanism. We have designed an adapter structure to incorporate reaction conditions into the chemical reaction representation, allowing the model to handle diverse reaction conditions and adapt to various datasets and downstream tasks, e.g., reaction performance prediction. Additionally, we introduce a reaction-center aware attention mechanism that enables the model to concentrate on key functional groups, thereby generating potent representations for chemical reactions. Our model has been evaluated on a range of downstream tasks, including reaction condition prediction, reaction yield prediction, and reaction selectivity prediction. Experimental results indicate that our model markedly outperforms existing chemical reaction representation learning architectures across all tasks. Notably, our model significantly outperforms all the baselines with up to 25\% (top-1) and 16\% (top-10) increased accuracy over the strongest baseline on USPTO\_CONDITION dataset for reaction condition prediction. We plan to open-source the code contingent upon the acceptance of the paper.

Mapping the space of chemical reactions using attention-based neural networks

Exploring Chemical Reaction Space with Machine Learning Models: Representation and Feature Perspective

Transformer Performance for Chemical Reactions: Analysis of Different Predictive and Evaluation Scenarios

A reagent-driven visual method for analyzing chemical reaction data

Extraction of organic chemistry grammar from unsupervised learning of chemical reactions

Neural networks for the prediction organic chemistry reactions

Quantum Mechanics and Machine Learning Synergies: Graph Attention Neural Networks to Predict Chemical Reactivity

Learning Chemical Reaction Representation with Reactant-Product Alignment

A generalized-template-based graph neural network for accurate organic reactivity prediction

"Found in Translation": Predicting Outcomes of Complex Organic Chemistry Reactions using Neural Sequence-to-Sequence Models

Harnessing Data Augmentation and Normalization Preprocessing to Improve the Performance of Chemical Reaction Predictions of Data-Driven Model

AI-driven Hypergraph Network of Organic Chemistry: Network Statistics and Applications in Reaction Classification

BERT Learns (and Teaches) Chemistry

Ideation and Evaluation of Novel Multicomponent Reactions via Mechanistic Network Analysis and Automation

Molecular Transformer - A Model for Uncertainty-Calibrated Chemical Reaction Prediction

An explainability framework for deep learning on chemical reactions exemplified by enzyme-catalysed reaction classification

Organic reaction mechanism classification using machine learning

Chemical-Reaction-Aware Molecule Representation Learning

ReactionT5: a large-scale pre-trained model towards application of limited reaction data