Deep Learning for Complex Chemical Systems

Wei Li,Guoqiang Wang,Jing Ma

DOI: https://doi.org/10.1093/nsr/nwad335

IF: 20.6

2023-01-01

National Science Review

Abstract:Deep learning forms a bridge between the local features of molecular fragments/localized orbitals and the global properties of complex systems, enabling multi-scale simulations of complex chemical systems and reaction processes.

What problem does this paper attempt to address?

Deep Learning in Chemistry

Adam C. Mater,Michelle L. Coote

DOI: https://doi.org/10.1021/acs.jcim.9b00266

IF: 6.162

2019-06-13

Journal of Chemical Information and Modeling

Abstract:Machine learning enables computers to address problems by learning from data. Deep learning is a type of machine learning that uses a hierarchical recombination of features to extract pertinent information and then learn the patterns represented in the data. Over the last eight years, its abilities have increasingly been applied to a wide variety of chemical challenges, from improving computational chemistry to drug and materials design and even synthesis planning. This review aims to explain the concepts of deep learning to chemists from any background and follows this with an overview of the diverse applications demonstrated in the literature. We hope that this will empower the broader chemical community to engage with this burgeoning field and foster the growing movement of deep learning accelerated chemistry.

chemistry, multidisciplinary, medicinal,computer science, interdisciplinary applications, information systems
Deep Learning for Molecular Orbitals

Daniel King,Daniel Grzenda,Ray Zhu,Nathaniel Hudson,Ian Foster,Laura Gagliardi

DOI: https://doi.org/10.26434/chemrxiv-2024-cvhtp

2024-04-30

Abstract:The advancement of deep learning in chemistry has resulted in state-of-the-art models that incorporate an increasing number of concepts from standard quantum chemistry, such as orbitals and Hamiltonians. With an eye towards the future development of these deep learning approaches, we present here what we believe to be the first work focused on assigning labels to orbitals, namely energies and characterizations, given the real-space descriptions of these orbitals from standard electronic structure theories such as Hartree-Fock. In addition to providing a foundation for future development, we expect these models to have immediate impact in automatizing and interpreting the results of advanced electronic structure approaches for chemical reactivity and spectroscopy.

Chemistry
Deep Learning for Multi-Scale Molecular Modeling

Jun Zhang,Yaokun Lei,Yi Isaac Yang,Yi Qin Gao

DOI: https://doi.org/10.26434/chemrxiv.9640814.v3

2020-01-01

Abstract:Molecular simulations are widely applied in the study of chemical and bio-physical systems. However, theaccessible timescales of atomistic simulations are limited, and extracting equilibrium properties of systemscontaining rare events remains challenging. Two distinct strategies are usually adopted in this regard: eithersticking to the atomistic level and performing enhanced sampling, or trading details for speed by leveragingcoarse-grained models. Although both strategies are promising, either of them, if adopted individually,exhibits severe limitations. In this paper we propose a machine-learning approach to ally both strategies sothat simulations on different scales can benefit mutually from their cross-talks: Accurate coarse-grained (CG)models can be inferred from the fine-grained (FG) simulations through deep generative learning; In turn, FGsimulations can be boosted by the guidance of CG models via deep reinforcement learning. Our methoddefines a variational and adaptive training objective which allows end-to-end training of parametricmolecular models using deep neural networks. Through multiple experiments, we show that our method isefficient and flexible, and performs well on challenging chemical and bio-molecular systems.
Deepks: A Comprehensive Data-Driven Approach Toward Chemically Accurate Density Functional Theory

Yixiao Chen,Linfeng Zhang,Han Wang,Weinan E

DOI: https://doi.org/10.1021/acs.jctc.0c00872

2021-01-01

Journal of Chemical Theory and Computation

Abstract:We propose a general machine learning-based framework for building an accurate and widely applicable energy functional within the framework of generalized Kohn-Sham density functional theory. To this end, we develop a way of training self-consistent models that are capable of taking large datasets from different systems and different kinds of labels. We demonstrate that the functional that results from this training procedure gives chemically accurate predictions on energy, force, dipole, and electron density for a large class of molecules. It can be continuously improved when more and more data are available.
Deep Learning and Computational Chemistry

Tim James,Dimitar Hristozov

DOI: https://doi.org/10.1007/978-1-0716-1787-8_5

2021-11-04

Abstract:Within the context of the latest resurgence in the application of artificial intelligence approaches, deep learning has undergone a renaissance over recent years. These methods have been applied to a number of problems in computational chemistry. Compared to other machine learning approaches, the practical performance advantages of deep neural networks are often unclear. However, deep learning does appear to offer a number of other advantages such as the facile incorporation of multitask learning and the enhancement of generative modeling. The high complexity of contemporary network architectures represents a potentially significant barrier to their future adoption due to the costs of training such models and challenges in interpreting their predictions. When combined with the relative paucity of very large datasets, it is interesting to reflect on whether deep learning is likely to have the kind of transformational impact on computational chemistry that it is commonly held to have had in other domains such as image recognition.
Deep learning in analytical chemistry

Bruno Debus,Hadi Parastar,Peter Harrington,Dmitry Kirsanov

DOI: https://doi.org/10.1016/j.trac.2021.116459

IF: 14.908

2021-12-01

TrAC Trends in Analytical Chemistry

Abstract:In recent years, extensive research in the field of Deep Learning (DL) has led to the development of a wide array of machine learning algorithms dedicated to solving complex tasks such as image classification or speech recognition. Due to their unprecedented ability to explore large volumes of data and extract meaningful hidden structures, DL models have naturally drawn attention from various fields in science. Analytical chemistry, in particular, has successfully benefited from the application of DL tools for extracting qualitative and quantitative information from high-dimensional and complex chemical measurements. This report provides introductory reading for understanding DL machinery and reviews recent analytical applications of these powerful algorithms.

chemistry, analytical
Deep learning for chemical reaction prediction

David Fooshee,Aaron Mood,Eugene Gutman,Mohammadamin Tavakoli,Gregor Urban,Frances Liu,Nancy Huynh,David Van Vranken,Pierre Baldi

DOI: https://doi.org/10.1039/c7me00107j

2018-01-01

Abstract:We describe a deep learning-based system for predicting chemical reactions and identifying experimentally-observed masses.

materials science, multidisciplinary,nanoscience & nanotechnology,chemistry, physical
Deep learning algorithms applied to computational chemistry

Abimael Guzman-Pando,Graciela Ramirez-Alonso,Carlos Arzate-Quintana,Javier Camarillo-Cisneros

DOI: https://doi.org/10.1007/s11030-023-10771-y

2023-12-29

Molecular Diversity

Abstract:Recently, there has been a significant increase in the use of deep learning techniques in the molecular sciences, which have shown high performance on datasets and the ability to generalize across data. However, no model has achieved perfect performance in solving all problems, and the pros and cons of each approach remain unclear to those new to the field. Therefore, this paper aims to review deep learning algorithms that have been applied to solve molecular challenges in computational chemistry. We proposed a comprehensive categorization that encompasses two primary approaches; conventional deep learning and geometric deep learning models. This classification takes into account the distinct techniques employed by the algorithms within each approach. We present an up-to-date analysis of these algorithms, emphasizing their key features and open issues. This includes details of input descriptors, datasets used, open-source code availability, task solutions, and actual research applications, focusing on general applications rather than specific ones such as drug discovery. Furthermore, our report discusses trends and future directions in molecular algorithm design, including the input descriptors used for each deep learning model, GPU usage, training and forward processing time, model parameters, the most commonly used datasets, libraries, and optimization schemes. This information aids in identifying the most suitable algorithms for a given task. It also serves as a reference for the datasets and input data frequently used for each algorithm technique. In addition, it provides insights into the benefits and open issues of each technique, and supports the development of novel computational chemistry systems.

chemistry, multidisciplinary, medicinal, applied
Deep Learning for Deep Chemistry: Optimizing the Prediction of Chemical Patterns

Tânia F. G. G. Cova,Alberto A. C. C. Pais

DOI: https://doi.org/10.3389/fchem.2019.00809

IF: 5.5

2019-11-26

Frontiers in Chemistry

Abstract:Computational Chemistry is currently a synergistic assembly between <i>ab initio</i> calculations, simulation, machine learning (ML) and optimization strategies for describing, solving and predicting chemical data and related phenomena. These include accelerated literature searches, analysis and prediction of physical and quantum chemical properties, transition states, chemical structures, chemical reactions, and also new catalysts and drug candidates. The generalization of scalability to larger chemical problems, rather than specialization, is now the main principle for transforming chemical tasks in multiple fronts, for which systematic and cost-effective solutions have benefited from ML approaches, including those based on deep learning (e.g. quantum chemistry, molecular screening, synthetic route design, catalysis, drug discovery). The latter class of ML algorithms is capable of combining raw input into layers of intermediate features, enabling bench-to-bytes designs with the potential to transform several chemical domains. In this review, the most exciting developments concerning the use of ML in a range of different chemical scenarios are described. A range of different chemical problems and respective rationalization, that have hitherto been inaccessible due to the lack of suitable analysis tools, is thus detailed, evidencing the breadth of potential applications of these emerging multidimensional approaches. Focus is given to the models, algorithms and methods proposed to facilitate research on compound design and synthesis, materials design, prediction of binding, molecular activity, and soft matter behavior. The information produced by pairing Chemistry and ML, through data-driven analyses, neural network predictions and monitoring of chemical systems, allows (i) prompting the ability to understand the complexity of chemical data, (ii) streamlining and designing experiments, (ii) discovering new molecular targets and materials, and also (iv) planning or rethinking forthcoming chemical challenges. In fact, optimization engulfs all these tasks directly.

chemistry, multidisciplinary
Deep Learning for Nonadiabatic Excited-State Dynamics.

G. Cui,Wen-Kai Chen,Pavlo O. Dral,Xiang‐Yang Liu,W. Fang

DOI: https://doi.org/10.1021/acs.jpclett.8b03026

2018-11-07

Abstract:In this work we show that deep learning (DL) can be used for exploring complex and highly nonlinear multistate potential energy surfaces of polyatomic molecules and related nonadiabatic dynamics. Our DL is based on deep neural networks (DNNs), which are used as accurate representations of the CASSCF ground- and excited-state potential energy surfaces (PESs) of CH2NH. After geometries near conical intersection are included in the training set, the DNN models accurately reproduce excited-state topological structures; photoisomerization paths; and, importantly, conical intersections. We have also demonstrated that the results from nonadiabatic dynamics run with the DNN models are very close to those from the dynamics run with the pure ab initio method. The present work should encourage further studies of using machine learning methods to explore excited-state potential energy surfaces and nonadiabatic dynamics of polyatomic molecules.

Chemistry,Medicine,Computer Science,Physics
Deep learning for computational chemistry

Garrett B. Goh,Nathan O. Hodas,Abhinav Vishnu

DOI: https://doi.org/10.1002/jcc.24764

2017-03-08

Journal of Computational Chemistry

Abstract:The rise and fall of artificial neural networks is well documented in the scientific literature of both computer science and computational chemistry. Yet almost two decades later, we are now seeing a resurgence of interest in deep learning, a machine learning algorithm based on multilayer neural networks. Within the last few years, we have seen the transformative impact of deep learning in many domains, particularly in speech recognition and computer vision, to the extent that the majority of expert practitioners in those field are now regularly eschewing prior established models in favor of deep learning models. In this review, we provide an introductory overview into the theory of deep neural networks and their unique properties that distinguish them from traditional machine learning algorithms used in cheminformatics. By providing an overview of the variety of emerging applications of deep neural networks, we highlight its ubiquity and broad applicability to a wide range of challenges in the field, including quantitative structure activity relationship, virtual screening, protein structure prediction, quantum chemistry, materials design, and property prediction. In reviewing the performance of deep neural networks, we observed a consistent outperformance against non-neural networks state-of-the-art models across disparate research topics, and deep neural network-based models often exceeded the "glass ceiling" expectations of their respective tasks. Coupled with the maturity of GPU-accelerated computing for training deep neural networks and the exponential growth of chemical data on which to train these networks on, we anticipate that deep learning algorithms will be a valuable tool for computational chemistry. © 2017 Wiley Periodicals, Inc.

chemistry, multidisciplinary
Deep Molecular Representation Learning via Fusing Physical and Chemical Information

Shuwen Yang,Ziyao Li,Guojie Song,Lingsheng Cai

DOI: https://doi.org/10.48550/arXiv.2112.04624

2021-11-28

Quantitative Methods

Abstract:Molecular representation learning is the first yet vital step in combining deep learning and molecular science. To push the boundaries of molecular representation learning, we present PhysChem, a novel neural architecture that learns molecular representations via fusing physical and chemical information of molecules. PhysChem is composed of a physicist network (PhysNet) and a chemist network (ChemNet). PhysNet is a neural physical engine that learns molecular conformations through simulating molecular dynamics with parameterized forces; ChemNet implements geometry-aware deep message-passing to learn chemical / biomedical properties of molecules. Two networks specialize in their own tasks and cooperate by providing expertise to each other. By fusing physical and chemical information, PhysChem achieved state-of-the-art performances on MoleculeNet, a standard molecular machine learning benchmark. The effectiveness of PhysChem was further corroborated on cutting-edge datasets of SARS-CoV-2.
Towards Predicting Equilibrium Distributions for Molecular Systems with Deep Learning

Shuxin Zheng,Jiyan He,Chang Liu,Yu Shi,Ziheng Lu,Weitao Feng,Fusong Ju,Jiaxi Wang,Jianwei Zhu,Yaosen Min,He Zhang,Shidi Tang,Hongxia Hao,Peiran Jin,Chi Chen,Frank Noé,Haiguang Liu,Tie-Yan Liu

2023-06-09

Abstract:Advances in deep learning have greatly improved structure prediction of molecules. However, many macroscopic observations that are important for real-world applications are not functions of a single molecular structure, but rather determined from the equilibrium distribution of structures. Traditional methods for obtaining these distributions, such as molecular dynamics simulation, are computationally expensive and often intractable. In this paper, we introduce a novel deep learning framework, called Distributional Graphormer (DiG), in an attempt to predict the equilibrium distribution of molecular systems. Inspired by the annealing process in thermodynamics, DiG employs deep neural networks to transform a simple distribution towards the equilibrium distribution, conditioned on a descriptor of a molecular system, such as a chemical graph or a protein sequence. This framework enables efficient generation of diverse conformations and provides estimations of state densities. We demonstrate the performance of DiG on several molecular tasks, including protein conformation sampling, ligand structure sampling, catalyst-adsorbate sampling, and property-guided structure generation. DiG presents a significant advancement in methodology for statistically understanding molecular systems, opening up new research opportunities in molecular science.

Chemical Physics,Machine Learning,Biomolecules
A Perspective on Deep Learning for Molecular Modeling and Simulations

Jun Zhang,Yao-Kun Lei,Zhen Zhang,Junhan Chang,Maodong Li,Xu Han,Lijiang Yang,Yi Isaac Yang,Yi Qin Gao

DOI: https://doi.org/10.1021/acs.jpca.0c04473

2020-08-27

Abstract:Deep learning is transforming many areas in science, and it has great potential in modeling molecular systems. However, unlike the mature deployment of deep learning in computer vision and natural language processing, its development in molecular modeling and simulations is still at an early stage, largely because the inductive biases of molecules are completely different from those of images or texts. Footed on these differences, we first reviewed the limitations of traditional deep learning models from the perspective of molecular physics and wrapped up some relevant technical advancement at the interface between molecular modeling and deep learning. We do not focus merely on the ever more complex neural network models; instead, we introduce various useful concepts and ideas brought by modern deep learning. We hope that transacting these ideas into molecular modeling will create new opportunities. For this purpose, we summarized several representative applications, ranging from supervised to unsupervised and reinforcement learning, and discussed their connections with the emerging trends in deep learning. Finally, we give an outlook for promising directions which may help address the existing issues in the current framework of deep molecular modeling.
Geometric deep learning for molecular property predictions with chemical accuracy across chemical space

Maarten R Dobbelaere,István Lengyel,Christian V Stevens,Kevin M Van Geem

DOI: https://doi.org/10.1186/s13321-024-00895-0

2024-08-13

Abstract:Chemical engineers heavily rely on precise knowledge of physicochemical properties to model chemical processes. Despite the growing popularity of deep learning, it is only rarely applied for property prediction due to data scarcity and limited accuracy for compounds in industrially-relevant areas of the chemical space. Herein, we present a geometric deep learning framework for predicting gas- and liquid-phase properties based on novel quantum chemical datasets comprising 124,000 molecules. Our findings reveal that the necessity for quantum-chemical information in deep learning models varies significantly depending on the modeled physicochemical property. Specifically, our top-performing geometric model meets the most stringent criteria for "chemically accurate" thermochemistry predictions. We also show that by carefully selecting the appropriate model featurization and evaluating prediction uncertainties, the reliability of the predictions can be strongly enhanced. These insights represent a crucial step towards establishing deep learning as the standard property prediction workflow in both industry and academia.Scientific contributionWe propose a flexible property prediction tool that can handle two-dimensional and three-dimensional molecular information. A thermochemistry prediction methodology that achieves high-level quantum chemistry accuracy for a broad application range is presented. Trained deep learning models and large novel molecular databases of real-world molecules are provided to offer a directly usable and fast property prediction solution to practitioners.
Unifying machine learning and quantum chemistry with a deep neural network for molecular wavefunctions

K. T. Schütt,M. Gastegger,A. Tkatchenko,K.-R. Müller,R. J. Maurer

DOI: https://doi.org/10.1038/s41467-019-12875-2

IF: 16.6

2019-11-15

Nature Communications

Abstract:Abstract Machine learning advances chemistry and materials science by enabling large-scale exploration of chemical space based on quantum chemical calculations. While these models supply fast and accurate predictions of atomistic chemical properties, they do not explicitly capture the electronic degrees of freedom of a molecule, which limits their applicability for reactive chemistry and chemical analysis. Here we present a deep learning framework for the prediction of the quantum mechanical wavefunction in a local basis of atomic orbitals from which all other ground-state properties can be derived. This approach retains full access to the electronic structure via the wavefunction at force-field-like efficiency and captures quantum mechanics in an analytically differentiable representation. On several examples, we demonstrate that this opens promising avenues to perform inverse design of molecular structures for targeting electronic property optimisation and a clear path towards increased synergy of machine learning and quantum chemistry.

multidisciplinary sciences
Deep Learning for Variational Multi-Scale Molecular Modeling

Jun Zhang,Yao-Kun Lei,Yi Isaac Yang,Yi Qin Gao

DOI: https://doi.org/10.1063/5.0026836

2020-01-01

Abstract:Molecular simulations are widely applied in the study of chemical and bio-physical problems. However, the accessible timescales of atomistic simulations are limited, and extracting equilibrium properties of systems containing rare events remains challenging. Two distinct strategies are usually adopted in this regard: either sticking to the atomistic level and performing enhanced sampling or trading details for speed by leveraging coarse-grained models. Although both strategies are promising, either of them, if adopted individually, exhibits severe limitations. In this paper, we propose a machine-learning approach to ally both strategies so that simulations on different scales can benefit mutually from their crosstalks: Accurate coarse-grained (CG) models can be inferred from the fine-grained (FG) simulations through deep generative learning; in turn, FG simulations can be boosted by the guidance of CG models via deep reinforcement learning. Our method defines a variational and adaptive training objective, which allows end-to-end training of parametric molecular models using deep neural networks. Through multiple experiments, we show that our method is efficient and flexible and performs well on challenging chemical and bio-molecular systems.
Unifying machine learning and quantum chemistry -- a deep neural network for molecular wavefunctions

K. T. Schütt,M. Gastegger,A. Tkatchenko,K. -R. Müller,R. J. Maurer,K.-R. Müller

DOI: https://doi.org/10.48550/arXiv.1906.10033

IF: 2.552

2019-06-24

Chemical Physics

Abstract:Machine learning advances chemistry and materials science by enabling large-scale exploration of chemical space based on quantum chemical calculations. While these models supply fast and accurate predictions of atomistic chemical properties, they do not explicitly capture the electronic degrees of freedom of a molecule, which limits their applicability for reactive chemistry and chemical analysis. Here we present a deep learning framework for the prediction of the quantum mechanical wavefunction in a local basis of atomic orbitals from which all other ground-state properties can be derived. This approach retains full access to the electronic structure via the wavefunction at force field-like efficiency and captures quantum mechanics in an analytically differentiable representation. On several examples, we demonstrate that this opens promising avenues to perform inverse design of molecular structures for target electronic property optimisation and a clear path towards increased synergy of machine learning and quantum chemistry.

Deep Learning for Complex Chemical Systems

Deep Learning in Chemistry

Deep Learning for Molecular Orbitals

Deep Learning for Multi-Scale Molecular Modeling

Deepks: A Comprehensive Data-Driven Approach Toward Chemically Accurate Density Functional Theory

Deep Learning and Computational Chemistry

Deep learning in analytical chemistry

Deep learning for chemical reaction prediction

Deep learning algorithms applied to computational chemistry

Deep Learning for Deep Chemistry: Optimizing the Prediction of Chemical Patterns

Deep Learning for Nonadiabatic Excited-State Dynamics.

Deep learning for computational chemistry

Deep Molecular Representation Learning via Fusing Physical and Chemical Information

Towards Predicting Equilibrium Distributions for Molecular Systems with Deep Learning

A Perspective on Deep Learning for Molecular Modeling and Simulations

Geometric deep learning for molecular property predictions with chemical accuracy across chemical space

Unifying machine learning and quantum chemistry with a deep neural network for molecular wavefunctions

Deep Learning for Variational Multi-Scale Molecular Modeling

Unifying machine learning and quantum chemistry -- a deep neural network for molecular wavefunctions