Abstract:Much of computational chemistry is concerned with ``bottom-up'' calculations which elucidate observable behavior starting from exact or approximated physical laws, a paradigm exemplified by typical quantum mechanical calculations and molecular dynamics simulations. On the other hand, ``top down'' computations aiming to formulate mathematical models consistent with observed data -- e.g., parameterizing force fields, binding or kinetic models -- have been of interest for decades but recently have grown in sophistication with the use of Bayesian inference (BI). Standard BI provides estimation of parameter values, uncertainties, and correlations among parameters. Used for ``model selection,'' BI can also distinguish between model structures, such as the presence or absence of individual states and transitions. Fortunately for physical scientists, BI can be formulated within a statistical mechanics framework and indeed BI has led to a resurgence of interest in Monte Carlo (MC) algorithms, many of which have been directly adapted from or inspired by physical strategies. Certain MC algorithms -- notably procedures using an ``infinite temperature'' reference state -- can be successful in a 5-20 parameter BI context which would be unworkable in molecular spaces of 10^3 coordinates and more. This Perspective provides a pedagogical introduction to BI and reviews key aspects of BI through a physical lens, setting the computations in terms of energy landscapes and free energy calculations, as well as describing promising sampling algorithms. Statistical mechanics and basic probability theory also provide a reference for understanding intrinsic limitations of Bayesian inference with regard to model selection and the choice of priors.

On computational tools for Bayesian data analysis

Bayesian Computational Tools

Approximate Methods for Bayesian Computation

An automatic adaptive method to combine summary statistics in approximate Bayesian computation

Bayesian Computing in the Undergraduate Statistics Curriculum

Overview of Approximate Bayesian Computation

Bayesian mechanistic inference, statistical mechanics, and a new era for Monte Carlo

ABC-CDE: Towards Approximate Bayesian Computation with Complex High-Dimensional Data and Limited Simulations

Bayesian computational algorithms for social network analysis

Bayesian inference in processing experimental data: principles and basic applications

Bayesian inference: More than Bayes's theorem

Practical Bayesian Inference in Neuroscience: Or How I Learned To Stop Worrying and Embrace the Distribution

Data Analysis Recipes: Using Markov Chain Monte Carlo

Bayesian Computation in Astronomy: Novel methods for parallel and gradient-free inference

Asymptotic Properties of Approximate Bayesian Computation

On the relevance of the Bayesian approach to Statistics

Optimal approximating Markov chains for Bayesian inference

Bayesian data analysis.

An Approximate Likelihood Perspective on ABC Methods

Toward a principled Bayesian workflow in cognitive science.