Choosing the right molecular machine learning potential

Max Pinheiro,Fuchun Ge,Nicolas Ferré,Pavlo O. Dral,Mario Barbatti

DOI: https://doi.org/10.1039/d1sc03564a

IF: 8.4

2021-01-01

Chemical Science

Abstract:This article provides a lifeline for those lost in the sea of the molecular machine learning potentials by providing a balanced overview and evaluation of popular potentials.

chemistry, multidisciplinary

What problem does this paper attempt to address?

Navigating micro- and nano-motors/swimmers with machine learning: Challenges and future directions

Jueyi Xue,Hamid Alinejad-Rokny,Kang Liang

DOI: https://doi.org/10.1016/j.chphma.2024.06.001

2024-07-01

ChemPhysMater

Abstract:Micro-/nano-motors (MNMs) or swimmers are minuscule machines that can convert various forms of energy, such as chemical, electrical, or magnetic energy, into motion. These devices have attracted significant attention owing to their potential application in a wide range of fields such as drug delivery, sensing, and microfabrication. However, owing to their diverse shapes, sizes, and structural/chemical compositions, the development of MNMs faces several challenges, such as understanding their structure-function relationships, which is crucial for achieving precise control over their motion within complex environments. In recent years, machine learning techniques have shown promise in addressing these challenges and improving the performance of MNMs. Machine learning techniques can analyze large amounts of data, learn from patterns, and make predictions, thereby enabling MNMs to navigate complex environments, avoid obstacles, and perform tasks with higher efficiency and reliability. This review introduces the current state-of-the-art machine learning techniques in MNM research, with a particular focus on employing machine learning to understand and manipulate the navigation and locomotion of MNMs. Finally, we discuss the challenges and opportunities in this field and suggest future research directions.
Machine Learning Potentials: A Roadmap Toward Next-Generation Biomolecular Simulations

Gianni De Fabritiis

2024-08-17

Abstract:Machine learning potentials offer a revolutionary, unifying framework for molecular simulations across scales, from quantum chemistry to coarse-grained models. Here, I explore their potential to dramatically improve accuracy and scalability in simulating complex molecular systems. I discuss key challenges that must be addressed to fully realize their transformative potential in chemical biology and related fields.

Chemical Physics,Machine Learning
Introduction to machine learning potentials for atomistic simulations

Fabian L. Thiemann,Niamh O'Neill,Venkat Kapil,Angelos Michaelides,Christoph Schran

2024-10-01

Abstract:Machine learning potentials have revolutionised the field of atomistic simulations in recent years and are becoming a mainstay in the toolbox of computational scientists. This paper aims to provide an overview and introduction into machine learning potentials and their practical application to scientific problems. We provide a systematic guide for developing machine learning potentials, reviewing chemical descriptors, regression models, data generation and validation approaches. We begin with an emphasis on the earlier generation of models, such as high-dimensional neural network potentials (HD-NNPs) and Gaussian approximation potential (GAP), to provide historical perspective and guide the reader towards the understanding of recent developments, which are discussed in detail thereafter. Furthermore, we refer to relevant expert reviews, open-source software, and practical examples - further lowering the barrier to exploring these methods. The paper ends with selected showcase examples, highlighting the capabilities of machine learning potentials and how they can be applied to push the boundaries in atomistic simulations.

Chemical Physics
Understanding the Limitations of Deep Models for Molecular Property Prediction: Insights and Solutions.

Jun Xia,Lecheng Zhang,Xiao Zhu,Yue Liu,Zhangyang Gao,Bozhen Hu,Cheng Tan,Jiangbin Zheng,Siyuan Li,Stan Z. Li

2023-01-01

Abstract:Molecular Property Prediction (MPP) is a crucial task in the AI-driven Drug Discovery (AIDD) pipeline, which has recently gained considerable attention thanks to advancements in deep learning. However, recent research has revealed that deep models struggle to beat traditional non-deep ones on MPP. In this study, we benchmark 12 representative models (3 non-deep models and 9 deep models) on 15 molecule datasets. Through the most comprehensive study to date, we make the following key observations: \textbf{(\romannumeral 1)} Deep models are generally unable to outperform non-deep ones; \textbf{(\romannumeral 2)} The failure of deep models on MPP cannot be solely attributed to the small size of molecular datasets; \textbf{(\romannumeral 3)} In particular, some traditional models including XGB and RF that use molecular fingerprints as inputs tend to perform better than other competitors. Furthermore, we conduct extensive empirical investigations into the unique patterns of molecule data and inductive biases of various models underlying these phenomena. These findings stimulate us to develop a simple-yet-effective feature mapping method for molecule data prior to feeding them into deep models. Empirically, deep models equipped with this mapping method can beat non-deep ones in most MoleculeNet datasets. Notably, the effectiveness is further corroborated by extensive experiments on cutting-edge dataset related to COVID-19 and activity cliff datasets.
MoleculeNet: A Benchmark for Molecular Machine Learning

Zhenqin Wu,Bharath Ramsundar,Evan N. Feinberg,Joseph Gomes,Caleb Geniesse,Aneesh S. Pappu,Karl Leswing,Vijay Pande

2018-10-26

Abstract:Molecular machine learning has been maturing rapidly over the last few years. Improved methods and the presence of larger datasets have enabled machine learning algorithms to make increasingly accurate predictions about molecular properties. However, algorithmic progress has been limited due to the lack of a standard benchmark to compare the efficacy of proposed methods; most new algorithms are benchmarked on different datasets making it challenging to gauge the quality of proposed methods. This work introduces MoleculeNet, a large scale benchmark for molecular machine learning. MoleculeNet curates multiple public datasets, establishes metrics for evaluation, and offers high quality open-source implementations of multiple previously proposed molecular featurization and learning algorithms (released as part of the DeepChem open source library). MoleculeNet benchmarks demonstrate that learnable representations are powerful tools for molecular machine learning and broadly offer the best performance. However, this result comes with caveats. Learnable representations still struggle to deal with complex tasks under data scarcity and highly imbalanced classification. For quantum mechanical and biophysical datasets, the use of physics-aware featurizations can be more important than choice of particular learning algorithm.

Machine Learning,Chemical Physics
Exposing the Limitations of Molecular Machine Learning with Activity Cliffs

Derek van Tilborg,Alisa Alenicheva,Francesca Grisoni

DOI: https://doi.org/10.1021/acs.jcim.2c01073

IF: 6.162

2022-12-02

Journal of Chemical Information and Modeling

Abstract:Machine learning has become a crucial tool in drug discovery and chemistry at large, e.g., to predict molecular properties, such as bioactivity, with high accuracy. However, activity cliffs─pairs of molecules that are highly similar in their structure but exhibit large differences in potency─have received limited attention for their effect on model performance. Not only are these edge cases informative for molecule discovery and optimization but also models that are well equipped to accurately...

chemistry, multidisciplinary, medicinal,computer science, interdisciplinary applications, information systems
Machine learning for molecular simulation

Frank Noé,Alexandre Tkatchenko,Klaus-Robert Müller,Cecilia Clementi

DOI: https://doi.org/10.1146/annurev-physchem-042018-052331

2019-11-07

Abstract:Machine learning (ML) is transforming all areas of science. The complex and time-consuming calculations in molecular simulations are particularly suitable for a machine learning revolution and have already been profoundly impacted by the application of existing ML methods. Here we review recent ML methods for molecular simulation, with particular focus on (deep) neural networks for the prediction of quantum-mechanical energies and forces, coarse-grained molecular dynamics, the extraction of free energy surfaces and kinetics and generative network approaches to sample molecular equilibrium structures and compute thermodynamics. To explain these methods and illustrate open methodological problems, we review some important principles of molecular physics and describe how they can be incorporated into machine learning structures. Finally, we identify and describe a list of open challenges for the interface between ML and molecular simulation.

Chemical Physics,Machine Learning,Computational Physics,Quantum Physics
Machine learning heralding a new development phase in molecular dynamics simulations

Eva Prašnikar,Martin Ljubič,Andrej Perdih,Jure Borišek,Perdih, Andrej,Borišek, Jure

DOI: https://doi.org/10.1007/s10462-024-10731-4

IF: 9.588

2024-03-30

Artificial Intelligence Review

Abstract:Molecular dynamics (MD) simulations are a key computational chemistry technique that provide dynamic insight into the underlying atomic-level processes in the system under study. These insights not only improve our understanding of the molecular world, but also aid in the design of experiments and targeted interventions. Currently, MD is associated with several limitations, the most important of which are: insufficient sampling, inadequate accuracy of the atomistic models, and challenges with proper analysis and interpretation of the obtained trajectories. Although numerous efforts have been made to address these limitations, more effective solutions are still needed. The recent development of artificial intelligence, particularly machine learning (ML), offers exciting opportunities to address the challenges of MD. In this review we aim to familiarize readers with the basics of MD while highlighting its limitations. The main focus is on exploring the integration of deep learning with MD simulations. The advancements made by ML are systematically outlined, including the development of ML-based force fields, techniques for improved conformational space sampling, and innovative methods for trajectory analysis. Additionally, the challenges and implications associated with the integration of ML and artificial intelligence are discussed. While the potential of ML-MD fusion is clearly established, further applications are needed to confirm its superiority over traditional methods. This comprehensive overview of the new perspectives of MD, which ML has opened up, serves as a gentle introduction to the exciting phase of MD development.

computer science, artificial intelligence
Machine Learning Small Molecule Properties in Drug Discovery

Nikolai Schapin,Maciej Majewski,Alejandro Varela,Carlos Arroniz,Gianni De Fabritiis

2023-08-03

Abstract:Machine learning (ML) is a promising approach for predicting small molecule properties in drug discovery. Here, we provide a comprehensive overview of various ML methods introduced for this purpose in recent years. We review a wide range of properties, including binding affinities, solubility, and ADMET (Absorption, Distribution, Metabolism, Excretion, and Toxicity). We discuss existing popular datasets and molecular descriptors and embeddings, such as chemical fingerprints and graph-based neural networks. We highlight also challenges of predicting and optimizing multiple properties during hit-to-lead and lead optimization stages of drug discovery and explore briefly possible multi-objective optimization techniques that can be used to balance diverse properties while optimizing lead candidates. Finally, techniques to provide an understanding of model predictions, especially for critical decision-making in drug discovery are assessed. Overall, this review provides insights into the landscape of ML models for small molecule property predictions in drug discovery. So far, there are multiple diverse approaches, but their performances are often comparable. Neural networks, while more flexible, do not always outperform simpler models. This shows that the availability of high-quality training data remains crucial for training accurate models and there is a need for standardized benchmarks, additional performance metrics, and best practices to enable richer comparisons between the different techniques and models that can shed a better light on the differences between the many techniques.

Biomolecules,Machine Learning,Quantitative Methods
OpenMM 8: Molecular Dynamics Simulation with Machine Learning Potentials

Peter Eastman,Raimondas Galvelis,Raúl P. Peláez,Charlles R. A. Abreu,Stephen E. Farr,Emilio Gallicchio,Anton Gorenko,Michael M. Henry,Frank Hu,Jing Huang,Andreas Krämer,Julien Michel,Joshua A. Mitchell,Vijay S. Pande,João PGLM Rodrigues,Jaime Rodriguez-Guerra,Andrew C. Simmonett,Sukrit Singh,Jason Swails,Philip Turner,Yuanqing Wang,Ivy Zhang,John D. Chodera,Gianni De Fabritiis,Thomas E. Markland

DOI: https://doi.org/10.1021/acs.jpcb.3c06662

IF: 3.466

2023-12-29

The Journal of Physical Chemistry B

Abstract:Machine learning plays an important and growing role in molecular simulation. The newest version of the OpenMM molecular dynamics toolkit introduces new features to support the use of machine learning potentials. Arbitrary PyTorch models can be added to a simulation and used to compute forces and energy. A higher-level interface allows users to easily model their molecules of interest with general purpose, pretrained potential functions. A collection of optimized CUDA kernels and custom PyTorch...

chemistry, physical
Automatic Selection of Atomic Fingerprints and Reference Configurations for Machine-Learning Potentials

Giulio Imbalzano,Andrea Anelli,Daniele Giofr é,Sinja Klees,J örg Behler,Michele Ceriotti

DOI: https://doi.org/10.1063/1.5024611

2018-04-06

Abstract:Machine learning of atomic-scale properties is revolutionizing molecular modelling, making it possible to evaluate inter-atomic potentials with first-principles accuracy, at a fraction of the costs. The accuracy, speed and reliability of machine-learning potentials, however, depends strongly on the way atomic configurations are represented, i.e. the choice of descriptors used as input for the machine learning method. The raw Cartesian coordinates are typically transformed in "fingerprints", or "symmetry functions", that are designed to encode, in addition to the structure, important properties of the potential-energy surface like its invariances with respect to rotation, translation and permutation of like atoms. Here we discuss automatic protocols to select a number of fingerprints out of a large pool of candidates, based on the correlations that are intrinsic to the training data. This procedure can greatly simplify the construction of neural network potentials that strike the best balance between accuracy and computational efficiency, and has the potential to accelerate by orders of magnitude the evaluation of Gaussian Approximation Potentials based on the Smooth Overlap of Atomic Positions kernel. We present applications to the construction of neural network potentials for water and for an Al-Mg-Si alloy, and to the prediction of the formation energies of small organic molecules using Gaussian process regression.

Computational Physics,Materials Science,Chemical Physics
Machine learning interatomic potential: Bridge the gap between small-scale models and realistic device-scale simulations

Guanjie Wang,Changrui Wang,Xuanguang Zhang,Zefeng Li,Jian Zhou,Zhimei Sun

DOI: https://doi.org/10.1016/j.isci.2024.109673

IF: 5.8

2024-04-04

iScience

Abstract:Machine learning interatomic potential (MLIP) overcomes the challenges of high computational costs in density-functional theory and the relatively low accuracy in classical large-scale molecular dynamics, facilitating more efficient and precise simulations in materials research and design. In this review, the current state of the four essential stages of MLIP is discussed, including data generation methods, material structure descriptors, six unique machine learning algorithms, and available software. Furthermore, the applications of MLIP in various fields are investigated, notably in phase-change memory materials, structure searching, material properties predicting, and the pre-trained universal models. Eventually, the future perspectives, consisting of standard datasets, transferability, generalization, and trade-off between accuracy and complexity in MLIPs, are reported.
Machine Learning in Molecular Dynamics Simulations of Biomolecular Systems

Christopher Kolloff,Simon Olsson

DOI: https://doi.org/10.48550/arXiv.2205.03135

IF: 6.064

2022-05-06

Biomolecules

Abstract:Machine learning (ML) has emerged as a pervasive tool in science, engineering, and beyond. Its success has also led to several synergies with molecular dynamics (MD) simulations, which we use to identify and characterize the major metastable states of molecular systems. Typically, we aim to determine the relative stabilities of these states and how rapidly they interchange. This information allows mechanistic descriptions of molecular mechanisms, enables a quantitative comparison with experiments, and facilitates their rational design. ML impacts all aspects of MD simulations -- from analyzing the data and accelerating sampling to defining more efficient or more accurate simulation models.
Machine Learning in Molecular Simulations of Biomolecules

Xing-Yue Guan,Heng-Yan Huang,Hua-Qi Peng,Yan-Hang Liu,Wen-Fei Li,Wang Wei

DOI: https://doi.org/10.7498/aps.72.20231624

2023-01-01

Abstract:Molecular simulation has already become a powerful tool for studying life principles at a molecular level.The past 50-year researches show that molecular simulation has been able to quantitatively characterize the kinetic and thermodynamic properties of complex molecular processes,such as protein folding and conformational changes.In recent years,the application of machine learning algorithms represented by deep learning has further promoted the development of molecular simulation.This work reviews machine learning methods in biomolecular simulation,focusing on the important progress made by machine learning algorithms in improving the accuracy of molecular force fields,the efficiency of molecular simulation conformation sampling,and also the processing of high-dimensional simulation data.The future researches to further overcome the bottleneck of accuracy and efficiency of molecular simulation,expand the scope of molecular simulation,and realize the integration of computational simulation and experimental based on machine learning technique is prospected.
Using Machine Learning Hamiltonians To Compute Molecular Motor Barrier Heights

Aaron Philip,Guoqing Zhou,Benjamin Nebgen

DOI: https://doi.org/10.48550/arXiv.2211.07181

IF: 2.552

2022-11-14

Chemical Physics

Abstract:Machine Learning Inter-atomic Potentials (MLIPs) have become a common tool in use by computational chemists due to their combination of accuracy and speed. Yet, it is still not clear how well these tools behave at or near transitions states found in complex molecules. Here we investigate the applicability of MLIPs in evaluating the transition barrier of two, complex, molecular motor systems: a 1st generation Feringa motor and the 9c alkene 2nd generation Feringa motor. We compared paths generated with the Hierarchically Interacting Particle Neural Network (HIP-NN), the PM3 semi-empirical quantum method (SEQM), PM3 interfaced with HIP-NN (SEQM+HIP-NN), and Density Functional Theory calculations. We found that using SEQM+HIP-NN to generate cheap, realistic pathway guesses then refining the intermediates with DFT allowed us to cheaply find realistic reaction paths and energy barriers matching experiment, providing evidence that deep learning can be used for high precision computational tasks such as transition path sampling while also suggesting potential application to high throughput screening.
Machine Learning for Molecular Dynamics on Long Timescales

Frank Noé

DOI: https://doi.org/10.48550/arXiv.1812.07669

2018-12-19

Abstract:Molecular Dynamics (MD) simulation is widely used to analyze the properties of molecules and materials. Most practical applications, such as comparison with experimental measurements, designing drug molecules, or optimizing materials, rely on statistical quantities, which may be prohibitively expensive to compute from direct long-time MD simulations. Classical Machine Learning (ML) techniques have already had a profound impact on the field, especially for learning low-dimensional models of the long-time dynamics and for devising more efficient sampling schemes for computing long-time statistics. Novel ML methods have the potential to revolutionize long-timescale MD and to obtain interpretable models. ML concepts such as statistical estimator theory, end-to-end learning, representation learning and active learning are highly interesting for the MD researcher and will help to develop new solutions to hard MD problems. With the aim of better connecting the MD and ML research areas and spawning new research on this interface, we define the learning problems in long-timescale MD, present successful approaches and outline some of the unsolved ML problems in this application field.

Chemical Physics,Machine Learning,Computational Physics
A physics-inspired approach to the understanding of molecular representations and models

Luke Dicks,David E. Graff,Kirk E. Jordan,Connor W. Coley,Edward O. Pyzer-Knapp

DOI: https://doi.org/10.1039/d3me00189j

IF: 4.92

2024-03-06

Molecular Systems Design & Engineering

Abstract:The story of machine learning in general, and its application to molecular design in particular, has been a tale of evolving representations of data. Understanding the implications of the use of a particular representation – including the existence of so-called 'activity cliffs' for cheminformatics models – is the key to their successful use for molecular discovery. In this work we present a physics-inspired methodology which exploits analogies between model response surfaces and energy landscapes to richly describe the relationship between the representation and the model. From these similarities, a metric emerges which is analogous to the commonly used frustration metric from the chemical physics community. This new property shows state-of-the-art prediction of model error, whilst belonging to a novel class of roughness measure that extends beyond the known data allowing the trivial identification of activity cliffs even in the absence of related training or evaluation data.

materials science, multidisciplinary,nanoscience & nanotechnology,chemistry, physical

Choosing the right molecular machine learning potential

Navigating micro- and nano-motors/swimmers with machine learning: Challenges and future directions

Machine Learning Potentials: A Roadmap Toward Next-Generation Biomolecular Simulations

Introduction to machine learning potentials for atomistic simulations

Understanding the Limitations of Deep Models for Molecular Property Prediction: Insights and Solutions.

MoleculeNet: A Benchmark for Molecular Machine Learning

Exposing the Limitations of Molecular Machine Learning with Activity Cliffs

Machine learning for molecular simulation

Machine learning heralding a new development phase in molecular dynamics simulations

Machine Learning Small Molecule Properties in Drug Discovery

OpenMM 8: Molecular Dynamics Simulation with Machine Learning Potentials

Automatic Selection of Atomic Fingerprints and Reference Configurations for Machine-Learning Potentials

Machine learning interatomic potential: Bridge the gap between small-scale models and realistic device-scale simulations

Machine Learning in Molecular Dynamics Simulations of Biomolecular Systems

Machine Learning in Molecular Simulations of Biomolecules

Using Machine Learning Hamiltonians To Compute Molecular Motor Barrier Heights

Machine Learning for Molecular Dynamics on Long Timescales

A physics-inspired approach to the understanding of molecular representations and models