Abstract:Bayesian inference provides a consistent method for the extraction of information from physics experiments even in ill-conditioned circumstances. The approach provides a unified rationale for data analysis, which both justifies many of the commonly used analysis procedures and reveals some of the implicit underlying assumptions. This review summarizes the general ideas of the Bayesian probability theory with emphasis on the application to the evaluation of experimental data. As case studies for Bayesian parameter estimation techniques examples ranging from extra-solar planet detection to the deconvolution of the apparatus functions for improving the energy resolution and change point estimation in time series are discussed. Special attention is paid to the numerical techniques suited for Bayesian analysis, with a focus on recent developments of Markov chain Monte Carlo algorithms for high-dimensional integration problems. Bayesian model comparison, the quantitative ranking of models for the explanation of a given data set, is illustrated with examples collected from cosmology, mass spectroscopy, and surface physics, covering problems such as background subtraction and automated outlier detection. Additionally the Bayesian inference techniques for the design and optimization of future experiments are introduced. Experiments, instead of being merely passive recording devices, can now be designed to adapt to measured data and to change the measurement strategy on the fly to maximize the information of an experiment. The applied key concepts and necessary numerical tools which provide the means of designing such inference chains and the crucial aspects of data fusion are summarized and some of the expected implications are highlighted.

Markov Chain Monte Carlo Methods for Bayesian Data Analysis in Astronomy

Bayesian Computation in Astronomy: Novel methods for parallel and gradient-free inference

A comparison of Bayesian sampling algorithms for high-dimensional particle physics and cosmology applications

Practical Guidance for Bayesian Inference in Astronomy

Bayesian functional data analysis in astronomy

Data Analysis Recipes: Using Markov Chain Monte Carlo

Markov Chain Monte Carlo for Bayesian Parametric Galaxy Modeling in LSST

Matching Bayesian and frequentist coverage probabilities when using an approximate data covariance matrix

A Conceptual Introduction to Markov Chain Monte Carlo Methods

Markov chain Monte Carlo methods in biostatistics

Robust Bayesian regression in astronomy

A simple introduction to Markov Chain Monte–Carlo sampling

CMBAnalysis: A Modern Framework for High-Precision Cosmic Microwave Background Analysis

Bayesian Model Averaging in Astrophysics: A Review

Markov Chain Monte Carlo in Practice

Bayesian astrostatistics: a backward look to the future

On Markov chain Monte Carlo methods for tall data

Bayesian inference in physics

An introduction to Bayesian inference in gravitational-wave astronomy: Parameter estimation, model selection, and hierarchical models

Stochastic Gradient Markov Chain Monte Carlo

The Convergence of Markov Chain Monte Carlo Methods: From the Metropolis Method to Hamiltonian Monte Carlo