Deep learning for chemical reaction prediction

David Fooshee,Aaron Mood,Eugene Gutman,Mohammadamin Tavakoli,Gregor Urban,Frances Liu,Nancy Huynh,David Van Vranken,Pierre Baldi

DOI: https://doi.org/10.1039/c7me00107j

2018-01-01

Abstract:We describe a deep learning-based system for predicting chemical reactions and identifying experimentally-observed masses.

materials science, multidisciplinary,nanoscience & nanotechnology,chemistry, physical

What problem does this paper attempt to address?

Uncertainty-calibrated deep learning for rapid identification of reaction mechanisms

Yan Liu,Yiming Mo,Youwei Cheng

DOI: https://doi.org/10.26434/chemrxiv-2022-gg647

2022-01-01

Abstract:Analyzing the reaction mechanism is the cornerstone across all chemistry disciplines. However, the existing reaction mechanism data only have limited coverage of the enormous chemical space and are usually collected from various sources, thus, limiting advanced machine learning tools to facilitate classical computational chemistry approaches for obtaining reaction mechanisms. Herein we present an uncertainty-calibrated learning-to-ranking (UC-LTR) model for constructing mechanistic reaction networks. UC-LTR model can make efficient and accurate prediction with quantitative uncertainty learned from inconsistent and sparse data sources. This allows a coherent utilization of existing data, improving the confidence of using predicted results for the following experimental or quantum chemistry refinement. We demonstrated this approach can provide efficient and reliable identification of reaction networks for high-temperature gas-phase reactions. This work showcase a practical deep learning strategy in fields of chemistry where the availability of high-quality big data is limited
Prediction of chemical reaction yields using deep learning

Philippe Schwaller,Alain C Vaucher,Teodoro Laino,Jean-Louis Reymond

DOI: https://doi.org/10.1088/2632-2153/abc81d

2021-03-01

Machine Learning: Science and Technology

Abstract:Abstract Artificial intelligence is driving one of the most important revolutions in organic chemistry. Multiple platforms, including tools for reaction prediction and synthesis planning based on machine learning, have successfully become part of the organic chemists’ daily laboratory, assisting in domain-specific synthetic problems. Unlike reaction prediction and retrosynthetic models, the prediction of reaction yields has received less attention in spite of the enormous potential of accurately predicting reaction conversion rates. Reaction yields models, describing the percentage of the reactants converted to the desired products, could guide chemists and help them select high-yielding reactions and score synthesis routes, reducing the number of attempts. So far, yield predictions have been predominantly performed for high-throughput experiments using a categorical (one-hot) encoding of reactants, concatenated molecular fingerprints, or computed chemical descriptors. Here, we extend the application of natural language processing architectures to predict reaction properties given a text-based representation of the reaction, using an encoder transformer model combined with a regression layer. We demonstrate outstanding prediction performance on two high-throughput experiment reactions sets. An analysis of the yields reported in the open-source USPTO data set shows that their distribution differs depending on the mass scale, limiting the data set applicability in reaction yields predictions.
Reinforcement Learning for Improving Chemical Reaction Performance

Ajnabiul Hoque,Mihir Surve,Shivaram Kalyanakrishnan,Raghavan B. Sunoj

DOI: https://doi.org/10.1021/jacs.4c08866

IF: 15

2024-10-04

Journal of the American Chemical Society

Abstract:Deep learning (DL) methods have gained notable prominence in predictive and generative tasks in molecular space. However, their application in chemical reactions remains grossly underutilized. Chemical reactions are intrinsically complex: typically involving multiple molecules besides bond-breaking/forming events. In reaction discovery, one aims to maximize yield and/or selectivity that depends on a number of factors, mostly centered on reacting partners and reaction conditions. Herein, we...

chemistry, multidisciplinary
AI for Interpretable Chemistry: Predicting Radical Mechanistic Pathways via Contrastive Learning

Mohammadamin Tavakoli,Yin Ting T.Chiu,Alexander Shmakov,Ann Marie Carlton,David Van Vranken,Pierre Baldi

2023-11-02

Abstract:Deep learning-based reaction predictors have undergone significant architectural evolution. However, their reliance on reactions from the US Patent Office results in a lack of interpretable predictions and limited generalization capability to other chemistry domains, such as radical and atmospheric chemistry. To address these challenges, we introduce a new reaction predictor system, RMechRP, that leverages contrastive learning in conjunction with mechanistic pathways, the most interpretable representation of chemical reactions. Specifically designed for radical reactions, RMechRP provides different levels of interpretation of chemical reactions. We develop and train multiple deep-learning models using RMechDB, a public database of radical reactions, to establish the first benchmark for predicting radical reactions. Our results demonstrate the effectiveness of RMechRP in providing accurate and interpretable predictions of radical reactions, and its potential for various applications in atmospheric chemistry.

Machine Learning,Chemical Physics
Deep Learning in Chemistry

Adam C. Mater,Michelle L. Coote

DOI: https://doi.org/10.1021/acs.jcim.9b00266

IF: 6.162

2019-06-13

Journal of Chemical Information and Modeling

Abstract:Machine learning enables computers to address problems by learning from data. Deep learning is a type of machine learning that uses a hierarchical recombination of features to extract pertinent information and then learn the patterns represented in the data. Over the last eight years, its abilities have increasingly been applied to a wide variety of chemical challenges, from improving computational chemistry to drug and materials design and even synthesis planning. This review aims to explain the concepts of deep learning to chemists from any background and follows this with an overview of the diverse applications demonstrated in the literature. We hope that this will empower the broader chemical community to engage with this burgeoning field and foster the growing movement of deep learning accelerated chemistry.

chemistry, multidisciplinary, medicinal,computer science, interdisciplinary applications, information systems
Deep Learning for Deep Chemistry: Optimizing the Prediction of Chemical Patterns

Tânia F. G. G. Cova,Alberto A. C. C. Pais

DOI: https://doi.org/10.3389/fchem.2019.00809

IF: 5.5

2019-11-26

Frontiers in Chemistry

Abstract:Computational Chemistry is currently a synergistic assembly between <i>ab initio</i> calculations, simulation, machine learning (ML) and optimization strategies for describing, solving and predicting chemical data and related phenomena. These include accelerated literature searches, analysis and prediction of physical and quantum chemical properties, transition states, chemical structures, chemical reactions, and also new catalysts and drug candidates. The generalization of scalability to larger chemical problems, rather than specialization, is now the main principle for transforming chemical tasks in multiple fronts, for which systematic and cost-effective solutions have benefited from ML approaches, including those based on deep learning (e.g. quantum chemistry, molecular screening, synthetic route design, catalysis, drug discovery). The latter class of ML algorithms is capable of combining raw input into layers of intermediate features, enabling bench-to-bytes designs with the potential to transform several chemical domains. In this review, the most exciting developments concerning the use of ML in a range of different chemical scenarios are described. A range of different chemical problems and respective rationalization, that have hitherto been inaccessible due to the lack of suitable analysis tools, is thus detailed, evidencing the breadth of potential applications of these emerging multidimensional approaches. Focus is given to the models, algorithms and methods proposed to facilitate research on compound design and synthesis, materials design, prediction of binding, molecular activity, and soft matter behavior. The information produced by pairing Chemistry and ML, through data-driven analyses, neural network predictions and monitoring of chemical systems, allows (i) prompting the ability to understand the complexity of chemical data, (ii) streamlining and designing experiments, (ii) discovering new molecular targets and materials, and also (iv) planning or rethinking forthcoming chemical challenges. In fact, optimization engulfs all these tasks directly.

chemistry, multidisciplinary
Deep Learning for Complex Chemical Systems

Wei Li,Guoqiang Wang,Jing Ma

DOI: https://doi.org/10.1093/nsr/nwad335

IF: 20.6

2023-01-01

National Science Review

Abstract:Deep learning forms a bridge between the local features of molecular fragments/localized orbitals and the global properties of complex systems, enabling multi-scale simulations of complex chemical systems and reaction processes.
A Unified View of Deep Learning for Reaction and Retrosynthesis Prediction: Current Status and Future Challenges

Ziqiao Meng,Peilin Zhao,Yang Yu,Irwin King

2023-06-28

Abstract:Reaction and retrosynthesis prediction are fundamental tasks in computational chemistry that have recently garnered attention from both the machine learning and drug discovery communities. Various deep learning approaches have been proposed to tackle these problems, and some have achieved initial success. In this survey, we conduct a comprehensive investigation of advanced deep learning-based models for reaction and retrosynthesis prediction. We summarize the design mechanisms, strengths, and weaknesses of state-of-the-art approaches. Then, we discuss the limitations of current solutions and open challenges in the problem itself. Finally, we present promising directions to facilitate future research. To our knowledge, this paper is the first comprehensive and systematic survey that seeks to provide a unified understanding of reaction and retrosynthesis prediction.

Machine Learning,Chemical Physics,Quantitative Methods
A deep learning framework for accurate reaction prediction and its application on high-throughput experimentation data

Baiqing Li,Shimin Su,Chan Zhu,Jie Lin,Xinyue Hu,Lebin Su,Zhunzhun Yu,Kuangbiao Liao,Hongming Chen

DOI: https://doi.org/10.1186/s13321-023-00732-w

2023-08-14

Journal of Cheminformatics

Abstract:In recent years, it has been seen that artificial intelligence (AI) starts to bring revolutionary changes to chemical synthesis. However, the lack of suitable ways of representing chemical reactions and the scarceness of reaction data has limited the wider application of AI to reaction prediction. Here, we introduce a novel reaction representation, GraphRXN, for reaction prediction. It utilizes a universal graph-based neural network framework to encode chemical reactions by directly taking two-dimension reaction structures as inputs. The GraphRXN model was evaluated by three publically available chemical reaction datasets and gave on-par or superior results compared with other baseline models. To further evaluate the effectiveness of GraphRXN, wet-lab experiments were carried out for the purpose of generating reaction data. GraphRXN model was then built on high-throughput experimentation data and a decent accuracy (R 2 of 0.712) was obtained on our in-house data. This highlights that the GraphRXN model can be deployed in an integrated workflow which combines robotics and AI technologies for forward reaction prediction.

chemistry, multidisciplinary,computer science, interdisciplinary applications, information systems
Data augmentation and transfer learning strategies for reaction prediction in low chemical data regimes

Yun Zhang,Ling Wang,Xinqiao Wang,Chengyun Zhang,Jiamin Ge,Jing Tang,An Su,Hongliang Duan

DOI: https://doi.org/10.1039/d0qo01636e

IF: 5.456

2021-01-01

Organic Chemistry Frontiers

Abstract:An effective and rapid deep learning method to predict chemical reactions contributes to the research and development of organic chemistry and drug discovery.

chemistry, organic
Prediction of chemical compounds properties using a deep learning model

Mykola Galushka,Chris Swain,Fiona Browne,Maurice D. Mulvenna,Raymond Bond,Darren Gray

DOI: https://doi.org/10.1007/s00521-021-05961-4

2021-06-04

Neural Computing and Applications

Abstract:Abstract The discovery of new medications in a cost-effective manner has become the top priority for many pharmaceutical companies. Despite decades of innovation, many of their processes arguably remain relatively inefficient. One such process is the prediction of biological activity. This paper describes a new deep learning model, capable of conducting a preliminary screening of chemical compounds in-silico. The model has been constructed using a variation autoencoder to generate chemical compound fingerprints, which have been used to create a regression model to predict their LogD property and a classification model to predict binding in selected assays from the ChEMBL dataset. The conducted experiments demonstrate accurate prediction of the properties of chemical compounds only using structural definitions and also provide several opportunities to improve upon this model in the future.

computer science, artificial intelligence
3DReact: Geometric deep learning for chemical reactions

Puck van Gerwen,Ksenia R. Briling,Charlotte Bunne,Vignesh Ram Somnath,Ruben Laplaza,Andreas Krause,Clemence Corminboeuf

DOI: https://doi.org/10.1021/acs.jcim.4c00104

2024-07-12

Abstract:Geometric deep learning models, which incorporate the relevant molecular symmetries within the neural network architecture, have considerably improved the accuracy and data efficiency of predictions of molecular properties. Building on this success, we introduce 3DReact, a geometric deep learning model to predict reaction properties from three-dimensional structures of reactants and products. We demonstrate that the invariant version of the model is sufficient for existing reaction datasets. We illustrate its competitive performance on the prediction of activation barriers on the GDB7-22-TS, Cyclo-23-TS and Proparg-21-TS datasets in different atom-mapping regimes. We show that, compared to existing models for reaction property prediction, 3DReact offers a flexible framework that exploits atom-mapping information, if available, as well as geometries of reactants and products (in an invariant or equivariant fashion). Accordingly, it performs systematically well across different datasets, atom-mapping regimes, as well as both interpolation and extrapolation tasks.

Chemical Physics,Machine Learning
ConvPred: A Deep Learning‐based Framework for Predictions of Potential Organic Reactions

Wenlong Wang,Qilei Liu,Yachao Dong,Jian Du,Qingwei Meng,Lei Zhang

DOI: https://doi.org/10.1002/aic.18019

IF: 4.167

2023-01-12

AIChE Journal

Abstract:The traditional theory‐based technologies on reaction prediction are not efficient due to their heavy dependence on human expertise and experience. To this end, this paper proposes a framework for predictions of potential organic reactions based on reaction templates and Two‐Dimensional Convolution Neural Network (2‐D CNN) model. The quantum mechanics‐based σ‐profiles and the sub‐molecular structure‐based ECFP4 are used individually to encode chemical reactions. Using 605,753 patented reactions extracted from the USPTO 1976‐2016 database and their generated counterparts, the 2‐D CNN models are trained to evaluate the likelihood of molecular transformations by learning the feature differences between reactants and products. The classification accuracies of the σ‐profiles‐based model and the ECFP4‐based model for the non‐trained reactions are 97.881% and 99.593%. Challenging reactions from literature involving identification of chemo‐, stereo‐, and regio‐selectivity are correctly predicted. Furthermore, a σ‐profiles‐based visual reaction fingerprint (VRF(σ)) is introduced to provide novel insights into the model interpretability. This article is protected by copyright. All rights reserved.

engineering, chemical
DeepReac+: deep active learning for quantitative modeling of organic chemical reactions

Yukang Gong,Dongyu Xue,Guohui Chuai,Jing Yu,Qi Liu

DOI: https://doi.org/10.1039/d1sc02087k

IF: 8.4

2021-01-01

Chemical Science

Abstract:Based on GNNs and active learning, DeepReac+ is designed as a universal framework for quantitative modeling of chemical reactions. It takes molecular structures as inputs directly and adapts to various prediction tasks with fewer training data.

chemistry, multidisciplinary
Unified Deep Learning Model for Multitask Reaction Predictions with Explanation

Jieyu Lu,Yingkai Zhang

DOI: https://doi.org/10.1021/acs.jcim.1c01467

2022-03-28

Abstract:There is significant interest and importance to develop robust machine learning models to assist organic chemistry synthesis. Typically, task-specific machine learning models for distinct reaction prediction tasks have been developed. In this work, we develop a unified deep learning model, T5Chem, for a variety of chemical reaction predictions tasks by adapting the "Text-to-Text Transfer Transformer" (T5) framework in natural language processing (NLP). On the basis of self-supervised pretraining with PubChem molecules, the T5Chem model can achieve state-of-the-art performances for four distinct types of task-specific reaction prediction tasks using four different open-source data sets, including reaction type classification on USPTO_TPL, forward reaction prediction on USPTO_MIT, single-step retrosynthesis on USPTO_50k, and reaction yield prediction on high-throughput C-N coupling reactions. Meanwhile, we introduced a new unified multitask reaction prediction data set USPTO_500_MT, which can be used to train and test five different types of reaction tasks, including the above four as well as a new reagent suggestion task. Our results showed that models trained with multiple tasks are more robust and can benefit from mutual learning on related tasks. Furthermore, we demonstrated the use of SHAP (SHapley Additive exPlanations) to explain T5Chem predictions at the functional group level, which provides a way to demystify sequence-based deep learning models in chemistry. T5Chem is accessible through https://yzhang.hpc.nyu.edu/T5Chem.
Geometric deep learning for molecular property predictions with chemical accuracy across chemical space

Maarten R Dobbelaere,István Lengyel,Christian V Stevens,Kevin M Van Geem

DOI: https://doi.org/10.1186/s13321-024-00895-0

2024-08-13

Abstract:Chemical engineers heavily rely on precise knowledge of physicochemical properties to model chemical processes. Despite the growing popularity of deep learning, it is only rarely applied for property prediction due to data scarcity and limited accuracy for compounds in industrially-relevant areas of the chemical space. Herein, we present a geometric deep learning framework for predicting gas- and liquid-phase properties based on novel quantum chemical datasets comprising 124,000 molecules. Our findings reveal that the necessity for quantum-chemical information in deep learning models varies significantly depending on the modeled physicochemical property. Specifically, our top-performing geometric model meets the most stringent criteria for "chemically accurate" thermochemistry predictions. We also show that by carefully selecting the appropriate model featurization and evaluating prediction uncertainties, the reliability of the predictions can be strongly enhanced. These insights represent a crucial step towards establishing deep learning as the standard property prediction workflow in both industry and academia.Scientific contributionWe propose a flexible property prediction tool that can handle two-dimensional and three-dimensional molecular information. A thermochemistry prediction methodology that achieves high-level quantum chemistry accuracy for a broad application range is presented. Trained deep learning models and large novel molecular databases of real-world molecules are provided to offer a directly usable and fast property prediction solution to practitioners.
Deep learning for computational chemistry

Garrett B. Goh,Nathan O. Hodas,Abhinav Vishnu

DOI: https://doi.org/10.1002/jcc.24764

2017-03-08

Journal of Computational Chemistry

Abstract:The rise and fall of artificial neural networks is well documented in the scientific literature of both computer science and computational chemistry. Yet almost two decades later, we are now seeing a resurgence of interest in deep learning, a machine learning algorithm based on multilayer neural networks. Within the last few years, we have seen the transformative impact of deep learning in many domains, particularly in speech recognition and computer vision, to the extent that the majority of expert practitioners in those field are now regularly eschewing prior established models in favor of deep learning models. In this review, we provide an introductory overview into the theory of deep neural networks and their unique properties that distinguish them from traditional machine learning algorithms used in cheminformatics. By providing an overview of the variety of emerging applications of deep neural networks, we highlight its ubiquity and broad applicability to a wide range of challenges in the field, including quantitative structure activity relationship, virtual screening, protein structure prediction, quantum chemistry, materials design, and property prediction. In reviewing the performance of deep neural networks, we observed a consistent outperformance against non-neural networks state-of-the-art models across disparate research topics, and deep neural network-based models often exceeded the "glass ceiling" expectations of their respective tasks. Coupled with the maturity of GPU-accelerated computing for training deep neural networks and the exponential growth of chemical data on which to train these networks on, we anticipate that deep learning algorithms will be a valuable tool for computational chemistry. © 2017 Wiley Periodicals, Inc.

chemistry, multidisciplinary
A Deep Learning-Based Chemical System for QSAR Prediction

ShanShan Hu,Peng Chen,Pengying Gu,Bing Wang

DOI: https://doi.org/10.1109/jbhi.2020.2977009

IF: 7.7

2020-10-01

IEEE Journal of Biomedical and Health Informatics

Abstract:Research on quantitative structure-activity relationships (QSAR) provides an effective approach to determine new hits and promising lead compounds during drug discovery. In the past decades, various works have gained good performance for QSAR with the development of machine learning. The rise of deep learning, along with massive accessible chemical databases, made improvement on the QSAR performance. This article proposes a novel deep-learning-based method to implement QSAR prediction by the concatenation of end-to-end encoder-decoder model and convolutional neural network (CNN) architecture. The encoder-decoder model is mainly used to generate fixed-size latent features to represent chemical molecules; while these features are then input into CNN framework to train a robust and stable model and finally to predict active chemicals. Two models with different schemes are investigated to evaluate the validity of our proposed model on the same data sets. Experimental results showed that our proposed method outperforms other state-of-the-art methods in successful identification of chemical molecule whether it is active.

computer science, interdisciplinary applications,mathematical & computational biology,medical informatics, information systems
Deep Learning Based Drug Metabolites Prediction

Disha Wang,Wenjun Liu,Zihao Shen,Lei Jiang,Jie Wang,Shiliang Li,Honglin Li

DOI: https://doi.org/10.3389/fphar.2019.01586

IF: 5.6

2020-01-30

Frontiers in Pharmacology

Abstract:Drug metabolism research plays a key role in the discovery and development of drugs. Based on the discovery of drug metabolites, new chemical entities can be identified and potential safety hazards caused by reactive or toxic metabolites can be minimized. Nowadays, computational methods are usually complementary tools for experiments. However, current metabolites prediction methods tend to have high false positive rates with low accuracy and are usually only used for specific enzyme systems. In order to overcome this difficulty, a method was developed in this paper by first establishing a database with broad coverage of SMARTS-coded metabolic reaction rule, and then extracting the molecular fingerprints of compounds to construct a classification model based on deep learning algorithms. The metabolic reaction rule database we built can supplement chemically reasonable negative reaction examples. Based on deep learning algorithms, the model could determine which reaction types are more likely to occur than the others. In the test set, our method can achieve the accuracy of 70% (Top-10), which is significantly higher than that of random guess and the rule-based method SyGMa. The results demonstrated that our method has a certain predictive ability and application value.

pharmacology & pharmacy

Deep learning for chemical reaction prediction

Uncertainty-calibrated deep learning for rapid identification of reaction mechanisms

Prediction of chemical reaction yields using deep learning

Reinforcement Learning for Improving Chemical Reaction Performance

AI for Interpretable Chemistry: Predicting Radical Mechanistic Pathways via Contrastive Learning

Deep Learning in Chemistry

Deep Learning for Deep Chemistry: Optimizing the Prediction of Chemical Patterns

Deep Learning for Complex Chemical Systems

A Unified View of Deep Learning for Reaction and Retrosynthesis Prediction: Current Status and Future Challenges

A deep learning framework for accurate reaction prediction and its application on high-throughput experimentation data

Data augmentation and transfer learning strategies for reaction prediction in low chemical data regimes

Prediction of chemical compounds properties using a deep learning model

3DReact: Geometric deep learning for chemical reactions

ConvPred: A Deep Learning‐based Framework for Predictions of Potential Organic Reactions

DeepReac+: deep active learning for quantitative modeling of organic chemical reactions

Unified Deep Learning Model for Multitask Reaction Predictions with Explanation

Geometric deep learning for molecular property predictions with chemical accuracy across chemical space

Deep learning for computational chemistry

A Deep Learning-Based Chemical System for QSAR Prediction

Deep Learning Based Drug Metabolites Prediction