Reading Theorie Analytique des Probabilites

Christian P. Robert

DOI: https://doi.org/10.48550/arXiv.1203.6249

2012-03-28

Abstract:This note is an extended read of my read of Laplace's book Theorie Analytique des Probabilites, when considered from a Bayesian viewpoint but without historical nor comparative pretentions. A deeper analysis is provided in Dale (1999).

Other Statistics,History and Overview

What problem does this paper attempt to address?

Harold Jeffreys's Theory of Probability Revisited

Christian P. Robert,Nicolas Chopin,Judith Rousseau

DOI: https://doi.org/10.1214/09-STS284

2010-01-18

Abstract:Published exactly seventy years ago, Jeffreys's Theory of Probability (1939) has had a unique impact on the Bayesian community and is now considered to be one of the main classics in Bayesian Statistics as well as the initiator of the objective Bayes school. In particular, its advances on the derivation of noninformative priors as well as on the scaling of Bayes factors have had a lasting impact on the field. However, the book reflects the characteristics of the time, especially in terms of mathematical rigor. In this paper we point out the fundamental aspects of this reference work, especially the thorough coverage of testing problems and the construction of both estimation and testing noninformative priors based on functional divergences. Our major aim here is to help modern readers in navigating in this difficult text and in concentrating on passages that are still relevant today.

Statistics Theory,History and Overview
Free probability for probabilists

Philippe Biane

DOI: https://doi.org/10.48550/arXiv.math/9809193

1998-09-30

Probability

Abstract:This is an introduction to some of the most probabilistic aspects of free probability theory.
Bayes, Jeffreys, Prior Distributions and the Philosophy of Statistics

Andrew Gelman

DOI: https://doi.org/10.1214/09-STS284D

2010-01-18

Abstract:Discussion of "Harold Jeffreys's Theory of Probability revisited," by Christian Robert, Nicolas Chopin, and Judith Rousseau, for Statistical Science [<a class="link-https" data-arxiv-id="0804.3173" href="https://arxiv.org/abs/0804.3173">arXiv:0804.3173</a>]

Methodology
English Translation of Poisson's "Recherches sur la probabilité des jugements en matière criminelle et en matière civile" / "Researches into the Probabilities of Judgements in Criminal and Civil Cases"

S. -D. Poisson,S.-D. Poisson

DOI: https://doi.org/10.48550/arXiv.1902.02782

2019-02-08

History and Overview

Abstract:In spite of its title, the book mostly treats probability theory: the law of large numbers (regarded as a principle); formal definition of a random variable and law of distribution; the misnamed Cauchy distribution; functions now named after Dirac; difference between objective and subjective probabilities; approximation of the Bernoulli theorem for rare events (but not yet the Poisson distribution); investigation of the significance of empirical discrepancies. Following Laplace, he actually attributed probability to applied mathematics. Poisson calculated the optimal number of jurors and of their majority for conviction/exoneration of the accused and in general studied the conditions enabling to minimize miscarriage of justice. He replaced guilty and innocent by convictable or not.
English Translation of Cournot's "Exposition de la théorie des chances et des probabilités" / "Exposition of the Theory of Chances and Probabilities"

A. A. Cournot

DOI: https://doi.org/10.48550/arXiv.1902.02781

2019-02-08

History and Overview

Abstract:In spite of the wide range of his book, Cournot did not know some essential discoveries in natural sciences (William Herschel, Daniel Bernoulli, Humboldt) and his deliberations about measurement were almost useless. But he introduced the median and a definition of probability that covered both the discrete and continuous cases; studied mixtures of densities; qualitatively explained randomness anticipating one of Poincar\`e's interpretations (small causes leading to considerable effects) and introducing an embryo of irregularity as a condition of randomness; introduced a pattern of stratified sampling; attempted to study dependence between the decisions of jurors; introduced (after J. F. Fries) philosophical, i.e. qualitative probabilities. Cournot stated that statistics ought to have its own theory, rules and principles and should penetrate into the essence of things (which was not yet a received opinion). Many of his pronouncements were thoughtful and echoed the statistical thought of the time. In 1849 his book was translated into German.
Extended Probabilities: Mathematical Foundations

Mark Burgin

DOI: https://doi.org/10.48550/arXiv.0912.4767

2009-12-24

Mathematical Physics

Abstract:There are important problems in physics related to the concept of probability. One of these problems is related to negative probabilities used in physics from 1930s. In spite of many demonstrations of usefulness of negative probabilities, physicists looked at them with suspicion trying to avoid this new concept in their theories. The main question that has bothered physicists is mathematical grounding and interpretation of negative probabilities. In this paper, we introduce extended probability as a probability function, which can take both positive and negative values. Defining extended probabilities in an axiomatic way, we show that classical probability is a positive section of extended probability.
Strong Limit Theorems for Extended Independent Random Variables and Extended Negatively Dependent Random Variables under Sub-Linear Expectations

Zhang Li-Xin

DOI: https://doi.org/10.1007/s10473-022-0203-z

2022-01-01

Acta Mathematica Scientia

Abstract:Limit theorems for non-additive probabilities or non-linear expectations are challenging issues which have attracted a lot of interest recently. The purpose of this paper is to study the strong law of large numbers and the law of the iterated logarithm for a sequence of random variables in a sub-linear expectation space under a concept of extended independence which is much weaker and easier to verify than the independence proposed by Peng [20]. We introduce a concept of extended negative dependence which is an extension of the kind of weak independence and the extended negative independence relative to classical probability that has appeared in the recent literature. Powerful tools such as moment inequality and Kolmogorov's exponential inequality are established for these kinds of extended negatively independent random variables, and these tools improve a lot upon those of Chen, Chen and Ng [1]. The strong law of large numbers and the law of iterated logarithm are also obtained by applying these inequalities.
Lectures on Probability Theory

Nima Moshayedi

DOI: https://doi.org/10.48550/arXiv.2010.16280

2020-10-29

Abstract:These are lecture notes written at the University of Zurich during spring 2014 and spring 2015. The first part of the notes gives an introduction to probability theory. It explains the notion of random events and random variables, probability measures, expectation, distributions, characteristic function, independence of random variables, types of convergence and limit theorems. The first part is separated into two different chapters. The first chapter is about combinatorial aspects of probability theory and the second chapter is the actual introduction to probability theory, which contains the modern probability language. The second part covers conditional expectations, martingales and Markov chains, which are easily accessible after reading the first part. The chapters are exactly covered in this order and go into some more details of the respective topic.

Probability
Error and inference: an outsider stand on a frequentist philosophy

Christian P. Robert

DOI: https://doi.org/10.1007/s11238-012-9298-3

2012-03-30

Theory and Decision

Abstract:This paper is an extended review of the book Error and Inference, edited by Deborah Mayo and Aris Spanos, about their frequentist and philosophical perspective on testing of hypothesis and on the criticisms of alternatives like the Bayesian approach.

economics,social sciences, mathematical methods
The expected demise of the Bayes factor

Christian P. Robert

DOI: https://doi.org/10.48550/arXiv.1506.08292

2015-07-27

Abstract:This note is a discussion commenting on the paper by Ly et al. on "Harold Jeffreys's Default Bayes Factor Hypothesis Tests: Explanation, Extension, and Application in Psychology" and on the perceived shortcomings of the classical Bayesian approach to testing, while reporting on an alternative approach advanced by Kamary, Mengersen, Robert and Rousseau (2014. <a class="link-https" data-arxiv-id="1412.2044" href="https://arxiv.org/abs/1412.2044">arXiv:1412.2044</a>) as a solution to this quintessential inference problem.

Methodology
An elementary approach to extreme values theory

Philippe Barbe

DOI: https://doi.org/10.48550/arXiv.0811.0753

2008-11-05

Abstract:This note presents a rather intuitive approach to extreme value theory. This approach was devised mostly for pedagogical reason.

Statistics Theory,Probability,Methodology
An outline of the Bayesian decision theory

H. R. N. van Erp,R. O. Linger,P. H. A. J. M. van Gelder

DOI: https://doi.org/10.1063/1.4959057

2016-01-01

AIP Conference Proceedings

Abstract:The Bayesian decision theory is neo-Bernoullian in that it proves, by way of a consistency derivation, that Bernoulli’s utility function is the only appropriate function by which to translate, for a given initial wealth, gains and losses to their corresponding utilities. But the Bayesian decision theory deviates from Bernoulli’s original expected utility theory in that it offers up an alternative for the traditional criterion of choice of expectation value maximization, as it proposes to choose that decision which has associated with it the utility probability distribution which maximizes the mean of the expectation value and the lower and upper confidence bounds.
A Domain Theory for Statistical Probabilistic Programming

Matthijs Vákár,Ohad Kammar,Sam Staton

DOI: https://doi.org/10.1145/3290349

2021-07-30

Abstract:We give an adequate denotational semantics for languages with recursive higher-order types, continuous probability distributions, and soft constraints. These are expressive languages for building Bayesian models of the kinds used in computational statistics and machine learning. Among them are untyped languages, similar to Church and WebPPL, because our semantics allows recursive mixed-variance datatypes. Our semantics justifies important program equivalences including commutativity. Our new semantic model is based on `quasi-Borel predomains'. These are a mixture of chain-complete partial orders (cpos) and quasi-Borel spaces. Quasi-Borel spaces are a recent model of probability theory that focuses on sets of admissible random elements. Probability is traditionally treated in cpo models using probabilistic powerdomains, but these are not known to be commutative on any class of cpos with higher order functions. By contrast, quasi-Borel predomains do support both a commutative probabilistic powerdomain and higher-order functions. As we show, quasi-Borel predomains form both a model of Fiore's axiomatic domain theory and a model of Kock's synthetic measure theory.

Logic in Computer Science,Programming Languages
Ramsey's contributions to probability and legal theory

F. E. Guerra-Pujol

DOI: https://doi.org/10.48550/arXiv.2003.13518

2020-03-30

Other Statistics

Abstract:Review of Cheryl Misak, Frank Ramsey: A Sheer Excess of Powers (Oxford University Press, 2020).
The Search for Certainty: a critical assessment

Christian P. Robert

DOI: https://doi.org/10.48550/arXiv.1001.5109

2010-03-31

Abstract:The Search for Certainty was published in 2009 by Krzysztof Burdzy. It examines the "philosophical duopoly" of von Mises and de Finetti at the foundation of probability and statistics and find this duopoly missing. This review exposes the weakness of the arguments presented in the book, it questions the relevance of introducing a new set of probability axioms from a methodological perspective, and it concludes at the lack of impact of this book on statistical foundations and practice.

Statistics Theory,History and Overview
Theory of Probability. A Historical Essay

Oscar Sheynin

DOI: https://doi.org/10.48550/arXiv.1802.09966

2018-02-27

History and Overview

Abstract:This book covers the history of probability up to Kolmogorov with essential additional coverage of statistics up to Fisher. Based on my work of ca. 50 years, it is the only suchlike book. Gorrochurn (2016) is similar but his study of events preceding Laplace is absolutely unsatisfactory. Hald (1990; 1998) are worthy indeed but the Continental direction of statistics (Russian and German statisticians) is omitted, it is impossible to find out what was contained in any particular memoir of Laplace and the explanation does not always explain the path from, say, Poisson to a modern interpretation of his results. Finally, the reader ought to master modern math. statistics. I included many barely known facts and conclusions, e. g., Gauss' justification of least squares (yes!), the merits of Bayes (again, yes!), the unforgivable mistake of Laplace, the work of Chebyshev and his students (merits and failures) etc., etc. The book covers an extremely wide field, and is targeted at the same readers as any other book on history of science. Mathematical treatment is not as difficult as it is for readers of Hald.
Strictly subgaussian probability distributions

S.G. Bobkov,G.P. Chistyakov,F. Götze

2023-08-03

Abstract:We explore the class of probability distributions on the real line whose Laplace transform admits a strong upper bound of subgaussian type. Using Hadamard's factorization theorem, we extend the class $\mathfrak L$ of Newman and propose new sufficient conditions for this property in terms of location of zeros of the associated characteristic functions in the complex plane. The second part of this note deals with Laplace transforms of strictly subgaussian distributions with periodic components. This subclass contains interesting examples, for which the central limit theorem with respect to the Rényi entropy divergence of infinite order holds.

Probability
Linear regression in the Bayesian framework

Thierry A. Mara

DOI: https://doi.org/10.48550/arXiv.1908.03329

2019-08-09

Abstract:These notes aim at clarifying different strategies to perform linear regression from given dataset. Methods like the weighted and ordinary least squares, ridge regression or LASSO are proposed in the literature. The present article is my understanding of these methods which are, according to me, better unified in the Bayesian framework. The formulas to address linear regression with these methods are derived. The KIC for model selection is also derived in the end of the document.

Methodology
An Introduction to Inductive Statistical Inference: from Parameter Estimation to Decision-Making

Henk van Elst

DOI: https://doi.org/10.48550/arXiv.1808.10173

2022-08-30

Abstract:These lecture notes aim at a post-Bachelor audience with a background at an introductory level in Applied Mathematics and Applied Statistics. They discuss the logic and methodology of the Bayes-Laplace approach to inductive statistical inference that places common sense and the guiding lines of the scientific method at the heart of systematic analyses of quantitative-empirical data. Following an exposition of exactly solvable cases of single- and two-parameter estimation problems, the main focus is laid on Markov Chain Monte Carlo (MCMC) simulations on the basis of Hamiltonian Monte Carlo sampling of posterior joint probability distributions for regression parameters occurring in generalised linear models for a univariate outcome variable. The modelling of fixed effects as well as of correlated varying effects via multi-level models in non-centred parametrisation is considered. The simulation of posterior predictive distributions is outlined. The assessment of a model's relative out-of-sample posterior predictive accuracy with information entropy-based criteria WAIC and LOOIC and model comparison with Bayes factors are addressed. A brief discussion on the description of the generation of stationary time series data by means of autoregressive models is contained. Concluding, a conceptual link to the behavioural subjective expected utility representation of a single decision-maker's choice behaviour in static one-shot decision problems is established. Vectorised codes for MCMC simulations of multi-dimensional posterior joint probability distributions with the Stan probabilistic programming language implemented in the statistical software R are provided. The lecture notes are fully hyperlinked. They direct the reader to original scientific research papers, online resources on inductive statistical inference, and to pertinent biographical information.

Applications
Lecture notes on the DiPerna-Lions theory in abstract measure spaces

Luigi Ambrosio,Dario Trevisan

DOI: https://doi.org/10.48550/arXiv.1505.05292

2016-09-12

Abstract:These notes closely correspond to a series of lectures given by the first author in Toulouse, on the recent extension of the theory of ODE well-posedness to abstract spaces, jointly obtained by the two authors. In the last part, we describe some further developments with respect to the theory of (possibly degenerate) diffusion processes, in a similar setting, contained in the second author's PhD thesis.

Metric Geometry,Analysis of PDEs,Probability

Reading Theorie Analytique des Probabilites

Harold Jeffreys's Theory of Probability Revisited

Free probability for probabilists

Bayes, Jeffreys, Prior Distributions and the Philosophy of Statistics

English Translation of Poisson's "Recherches sur la probabilité des jugements en matière criminelle et en matière civile" / "Researches into the Probabilities of Judgements in Criminal and Civil Cases"

English Translation of Cournot's "Exposition de la théorie des chances et des probabilités" / "Exposition of the Theory of Chances and Probabilities"

Extended Probabilities: Mathematical Foundations

Strong Limit Theorems for Extended Independent Random Variables and Extended Negatively Dependent Random Variables under Sub-Linear Expectations

Lectures on Probability Theory

Error and inference: an outsider stand on a frequentist philosophy

The expected demise of the Bayes factor

An elementary approach to extreme values theory

An outline of the Bayesian decision theory

A Domain Theory for Statistical Probabilistic Programming

Ramsey's contributions to probability and legal theory

The Search for Certainty: a critical assessment

Theory of Probability. A Historical Essay

Strictly subgaussian probability distributions

Linear regression in the Bayesian framework

An Introduction to Inductive Statistical Inference: from Parameter Estimation to Decision-Making

Lecture notes on the DiPerna-Lions theory in abstract measure spaces