Abstract:Chemical reaction prediction, encompassing forward synthesis and retrosynthesis, stands as a fundamental challenge in organic synthesis. A widely adopted computational approach frames synthesis prediction as a sequence-to-sequence translation task, using the common SMILES representation for molecules. Current evaluation of machine learning methods for retrosynthesis assume perfect training data, overlooking imperfections in reaction equations in popular datasets, such as missing reactants, products, other physical and practical constraints such as temperature and cost, primarily driven by a focus on the target molecule. This limitation leads to an incomplete representation of viable synthetic routes, especially when multiple sets of reactants can yield a given desired product. In response to these shortcomings, this study examines the prevailing evaluation methods and introduces comprehensive metrics designed to address imperfections in the dataset. Our novel metrics not only assess absolute accuracy by comparing predicted outputs with ground truth but also introduce a nuanced evaluation approach. We provide scores for partial correctness and compute adjusted accuracy through graph matching, acknowledging the inherent complexities of retrosynthetic pathways. Additionally, we explore the impact of small molecular augmentations while preserving chemical properties and employ similarity matching to enhance the assessment of prediction quality. We introduce SynFormer, a sequence-to-sequence model tailored for SMILES representation. It incorporates architectural enhancements to the original transformer, effectively tackling the challenges of chemical reaction prediction. SynFormer achieves a top-1 accuracy of 53.2% on the USPTO-50k dataset, demonstrating an improvement over previous state-of-the-art language models while being more efficient and eliminating the need for pre-training.

Transformer Performance for Chemical Reactions: Analysis of Different Predictive and Evaluation Scenarios

Harnessing Data Augmentation and Normalization Preprocessing to Improve the Performance of Chemical Reaction Predictions of Data-Driven Model

Reagent prediction with a molecular transformer improves reaction data quality

Molecular Transformer - A Model for Uncertainty-Calibrated Chemical Reaction Prediction

Predicting Enzymatic Reactions with a Molecular Transformer

State-of-the-art augmented NLP transformer models for direct and single-step retrosynthesis

Specialising and Analysing Instruction-Tuned and Byte-Level Language Models for Organic Reaction Prediction

Chemical transformer compression for accelerating both training and inference of molecular modeling

Chemical Graph-Based Transformer Models for Yield Prediction of High-Throughput Cross-Coupling Reaction Datasets

Application of Transformers in Cheminformatics

Multimodal Transformer-based Model for Buchwald-Hartwig and Suzuki-Miyaura Reaction Yield Prediction

Pre-training Transformers for Molecular Property Prediction Using Reaction Prediction

Prediction of chemical reaction yields using deep learning

Heck Reaction Prediction Using a Transformer Model Based on a Transfer Learning Strategy

Dissecting Errors in Machine Learning for Retrosynthesis: A Granular Metric Framework and Transformer-Based Model for More Informative Predictions

Chemformer: a pre-trained transformer for computational chemistry

Mapping the space of chemical reactions using attention-based neural networks

Beyond the Typical: Modeling Rare Plausible Patterns in Chemical Reactions by Leveraging Sequential Mixture-of-Experts

Prediction of Organic Reaction Outcomes Using Machine Learning