Abstract:Bayesian inference provides a consistent method for the extraction of information from physics experiments even in ill-conditioned circumstances. The approach provides a unified rationale for data analysis, which both justifies many of the commonly used analysis procedures and reveals some of the implicit underlying assumptions. This review summarizes the general ideas of the Bayesian probability theory with emphasis on the application to the evaluation of experimental data. As case studies for Bayesian parameter estimation techniques examples ranging from extra-solar planet detection to the deconvolution of the apparatus functions for improving the energy resolution and change point estimation in time series are discussed. Special attention is paid to the numerical techniques suited for Bayesian analysis, with a focus on recent developments of Markov chain Monte Carlo algorithms for high-dimensional integration problems. Bayesian model comparison, the quantitative ranking of models for the explanation of a given data set, is illustrated with examples collected from cosmology, mass spectroscopy, and surface physics, covering problems such as background subtraction and automated outlier detection. Additionally the Bayesian inference techniques for the design and optimization of future experiments are introduced. Experiments, instead of being merely passive recording devices, can now be designed to adapt to measured data and to change the measurement strategy on the fly to maximize the information of an experiment. The applied key concepts and necessary numerical tools which provide the means of designing such inference chains and the crucial aspects of data fusion are summarized and some of the expected implications are highlighted.

Computing Bayes: From Then 'Til Now'

Bayesian Computational Tools

From EM to Data Augmentation: The Emergence of MCMC Bayesian Computation in the 1980s

On computational tools for Bayesian data analysis

Bayesian Computing in the Undergraduate Statistics Curriculum

Bayes and big data: the consensus Monte Carlo algorithm

Bayesian inference: More than Bayes's theorem

Approximate Methods for Bayesian Computation

Bayesian mechanistic inference, statistical mechanics, and a new era for Monte Carlo

Optimal approximating Markov chains for Bayesian inference

The Convergence of Markov Chain Monte Carlo Methods: From the Metropolis Method to Hamiltonian Monte Carlo

Discussion of Big Bayes Stories and BayesBag

BayesDB: A probabilistic programming system for querying the probable implications of data

Bayesian Computation in Astronomy: Novel methods for parallel and gradient-free inference

Efficient Bayesian Computation by Proximal Markov Chain Monte Carlo: When Langevin Meets Moreau

Bayesian inference in processing experimental data: principles and basic applications

Leave Pima Indians alone: binary regression as a benchmark for Bayesian computation

Harold Jeffreys's Theory of Probability Revisited

MCMC-Based Inference in the Era of Big Data: A Fundamental Analysis of the Convergence Complexity of High-Dimensional Chains

Bayesian inference in physics