Abstract:We present a differentiable formalism for learning free energies that is capable of capturing arbitrarily complex model dependencies on coarse-grained coordinates and finite-temperature response to variation of general system parameters. This is done by endowing models with explicit dependence on temperature and parameters and by exploiting exact differential thermodynamic relationships between the free energy, ensemble averages, and response properties. Formally, we derive an approach for learning high-dimensional cumulant generating functions using statistical estimates of their derivatives, which are observable cumulants of the underlying random variable. The proposed formalism opens ways to resolve several outstanding challenges in bottom-up molecular coarse graining dealing with multiple minima and state dependence. This is realized by using additional differential relationships in the loss function to significantly improve the learning of free energies, while exactly preserving the Boltzmann distribution governing the corresponding fine-grain all-atom system. As an example, we go beyond the standard force-matching procedure to demonstrate how leveraging the thermodynamic relationship between free energy and values of ensemble averaged all-atom potential energy improves the learning efficiency and accuracy of the free energy model. The result is significantly better sampling statistics of structural distribution functions. The theoretical framework presented here is demonstrated via implementations in both kernel-based and neural network machine learning regression methods and opens new ways to train accurate machine learning models for studying thermodynamic and response properties of complex molecular systems.

Differentiable thermodynamic modeling

Thermodynamically Informed Multimodal Learning of High-Dimensional Free Energy Models in Molecular Coarse Graining

Deep generative modelling of canonical ensemble with differentiable thermal properties

A differentiable programming framework for spin models

A Novel Perspective Process Simulation Framework Based on Automatic Differentiation

A general differentiable layout optimization framework for heat transfer problems

Differentiable modeling to unify machine learning and physical models and advance Geosciences

Modeling Heat Conduction with Dual-Dissipative Variables: A Mechanism-Data Fusion Method

Differentiable Physics: A Position Piece

Differentiable modelling to unify machine learning and physical models for geosciences

Machine Learning for Predicting Thermodynamic Properties of Pure Fluids and Their Mixtures

General Numerical Framework to Derive Structure Preserving Reduced Order Models for Thermodynamically Consistent Reversible-Irreversible PDEs

Generative Discovery of Novel Chemical Designs using Diffusion Modeling and Transformer Deep Neural Networks with Application to Deep Eutectic Solvents

Differentiable Molecular Simulations for Control and Learning

Machine Learning for Molecular Thermodynamics

Differentiable modeling and optimization of non-aqueous Li-based battery electrolyte solutions using geometric deep learning

Differentiable biology: using deep learning for biophysics-based and data-driven modeling of molecular mechanisms

Thermodynamic phase-field model for microstructure with multiple components and phases: The possibility of metastable phases

On the continuous modeling of fluid and solid states