Probability theory and its models

Paul Humphreys

DOI: https://doi.org/10.1214/193940307000000347

2008-05-19

Abstract:This paper argues for the status of formal probability theory as a mathematical, rather than a scientific, theory. David Freedman and Philip Stark's concept of model based probabilities is examined and is used as a bridge between the formal theory and applications.

Probability

What problem does this paper attempt to address?

Imprecise Probabilities From Imprecise Descriptions Of Real Numbers

Jonathan Lawry,Ines Gonzalez-Rodr ´ õguez,Yongchuan Tang

2009-01-01

Abstract:A prototype theory interpretation of the label semantics framework is proposed as a possible model of imprecise descriptions of real numbers. It is shown that within this framework conditioning given imprecise descriptions of a real variable naturally results in imprecise probabilities. An inference method is proposed from data in the form of a set of imprecise descriptions, which naturally suggests an algorithm for estimating lower and upper probabilities given imprecise data values.
Extended Probabilities: Mathematical Foundations

Mark Burgin

DOI: https://doi.org/10.48550/arXiv.0912.4767

2009-12-24

Mathematical Physics

Abstract:There are important problems in physics related to the concept of probability. One of these problems is related to negative probabilities used in physics from 1930s. In spite of many demonstrations of usefulness of negative probabilities, physicists looked at them with suspicion trying to avoid this new concept in their theories. The main question that has bothered physicists is mathematical grounding and interpretation of negative probabilities. In this paper, we introduce extended probability as a probability function, which can take both positive and negative values. Defining extended probabilities in an axiomatic way, we show that classical probability is a positive section of extended probability.
Phantom Probability

Yehuda Izhakian,Zur Izhakian

DOI: https://doi.org/10.48550/arXiv.0901.0902

2009-01-07

Probability

Abstract:Classical probability theory supports probability measures, assigning a fixed positive real value to each event, these measures are far from satisfactory in formulating real-life occurrences. The main innovation of this paper is the introduction of a new probability measure, enabling varying probabilities that are recorded by ring elements to be assigned to events; this measure still provides a Bayesian model, resembling the classical probability model. By introducing two principles for the possible variation of a probability (also known as uncertainty, ambiguity, or imprecise probability), together with the "correct" algebraic structure allowing the framing of these principles, we present the foundations for the theory of phantom probability, generalizing classical probability theory in a natural way. This generalization preserves many of the well-known properties, as well as familiar distribution functions, of classical probability theory: moments, covariance, moment generating functions, the law of large numbers, and the central limit theorem are just a few of the instances demonstrating the concept of phantom probability theory.
Free probability for probabilists

Philippe Biane

DOI: https://doi.org/10.48550/arXiv.math/9809193

1998-09-30

Probability

Abstract:This is an introduction to some of the most probabilistic aspects of free probability theory.
Methods of free probability

Teo Banica

2024-08-30

Abstract:This is a joint introduction to classical and free probability, which are twin sisters. We first review the foundations of classical probability, notably with the main limiting theorems (CLT, CCLT, PLT, CPLT), and with a look into examples coming from Lie groups and random matrices. Then we present the foundations and main results of free probability, notably with free limiting theorems, and with a look into examples coming from quantum groups and random matrices. We discuss then a number of more advanced aspects, in relation with free geometry and with subfactor theory.

Probability,Mathematical Physics,Combinatorics,Quantum Algebra
Theory of Probability. An Elementary Treatise against a Historical Background

Oscar Sheynin

DOI: https://doi.org/10.48550/arXiv.1802.03485

2018-02-10

Abstract:A popular scientific contribution should not contradict any established facts and ought to be understandable. I complied with both these requirements and am offering a sufficiently full introduction to probability theory. Furthermore, I enlivened my text with much information about the history of probability and commentaries on the occurring notions which do not belong to that theory. Indeed, a student is not a container to be filled but a torch to be kindled. I hope therefore that my piece will essentially benefit beginners, be also methodically useful to advanced readers, and even attract some inquisitive people to probability.

History and Overview
Probability as a Modal Operator

Alan M. Frisch,Peter Haddawy

DOI: https://doi.org/10.48550/arXiv.1304.2352

2013-03-28

Abstract:This paper argues for a modal view of probability. The syntax and semantics of one particularly strong probability logic are discussed and some examples of the use of the logic are provided. We show that it is both natural and useful to think of probability as a modal operator. Contrary to popular belief in AI, a probability ranging between 0 and 1 represents a continuum between impossibility and necessity, not between simple falsity and truth. The present work provides a clear semantics for quantification into the scope of the probability operator and for higher-order probabilities. Probability logic is a language for expressing both probabilistic and logical concepts.

Artificial Intelligence
Physics with exotic probability theory

Saul Youssef

DOI: https://doi.org/10.48550/arXiv.hep-th/0110253

2001-10-29

High Energy Physics - Theory

Abstract:Probability theory can be modified in essentially one way while maintaining consistency with the basic Bayesian framework. This modification results in copies of standard probability theory for real, complex or quaternion probabilities. These copies, in turn, allow one to derive quantum theory while restoring standard probability theory in the classical limit. The argument leading to these three copies constrain physical theories in the same sense that Cox's original arguments constrain alternatives to standard probability theory. This sequence is presented in some detail with emphasis on questions beyond basic quantum theory where new insights are needed.
Model theoretic events

Kyle Gannon,James E. Hanson

2024-02-24

Abstract:How do we randomly sample an infinite sequence from a first order structure? What properties might hold on almost all random sequences? Which kinds of probabilistic processes can be meaningfully applied and studied in the model theory context? This paper takes these questions seriously and advances a plausible framework to engage with probabilistic phenomena. The central object of this paper is a probability space. The underlying set of our space is a standard model theoretic object, i.e. the space of types in countably many variables over a monster model. Our probability measure is the iterated Morley product of a fixed Borel-definable Keisler measure. Choosing a point randomly in this space with respect to our distribution yields a "random generic type" in countably many variables. We are interested in which events hold for almost all random generic types. We consider two different flavors of model theoretic events: (1) When is the induced structure on almost all random generic types isomorphic to a fixed structure? (2) For a fixed formula which is unstable, IP, sOP, etc., what is the probability that a random generic type witnesses this dividing line? For (1), we show that if our measure satisfies a particular extension axiom, then there exists a structure $N$ such that the induced structure on almost all random generic types is isomorphic to $N$. The proof echos a celebrated result of Glebskii et al. and Fagin concerning the existence of almost sure theories. We also provide examples where no such model exists. For (2), we show that if our initial distribution is fim, then almost no random generic types witness instability, IP, or sOP. In the local NIP context, we use results from combinatorics to prove that for any Borel-definable measure, the "average value of witnessing k-instability" across all permutations converges to 0. Some examples are provided.

Probability,Logic
Possibility Theory and Its Applications: Where Do We Stand?

Didier Dubois,Henry Prade

DOI: https://doi.org/10.1007/978-3-662-43505-2_3

2015-01-01

Abstract:This chapter provides an overview of possibility theory, emphasizing its historical roots and its recent developments. Possibility theory lies at the crossroads between fuzzy sets, probability, and nonmonotonic reasoning. Possibility theory can be cast either in an ordinal or in a numerical setting. Qualitative possibility theory is closely related to belief revision theory, and commonsense reasoning with exception-tainted knowledge in artificial intelligence. Possibilistic logic provides a rich representation setting, which enables the handling of lower bounds of possibility theory measures, while remaining close to classical logic. Qualitative possibility theory has been axiomatically justified in a decision-theoretic framework in the style of Savage, thus providing a foundation for qualitative decision theory. Quantitative possibility theory is the simplest framework for statistical reasoning with imprecise probabilities. As such, it has close connections with random set theory and confidence intervals, and can provide a tool for uncertainty propagation with limited statistical or subjective information.
Harold Jeffreys's Theory of Probability Revisited

Christian P. Robert,Nicolas Chopin,Judith Rousseau

DOI: https://doi.org/10.1214/09-STS284

2010-01-18

Abstract:Published exactly seventy years ago, Jeffreys's Theory of Probability (1939) has had a unique impact on the Bayesian community and is now considered to be one of the main classics in Bayesian Statistics as well as the initiator of the objective Bayes school. In particular, its advances on the derivation of noninformative priors as well as on the scaling of Bayes factors have had a lasting impact on the field. However, the book reflects the characteristics of the time, especially in terms of mathematical rigor. In this paper we point out the fundamental aspects of this reference work, especially the thorough coverage of testing problems and the construction of both estimation and testing noninformative priors based on functional divergences. Our major aim here is to help modern readers in navigating in this difficult text and in concentrating on passages that are still relevant today.

Statistics Theory,History and Overview
On the relation between quantum theory and probability

Louis Marchildon

DOI: https://doi.org/10.48550/arXiv.2108.08848

2021-08-19

Abstract:The theory of probability and the quantum theory, the one mathematical and the other physical, are related in that each admits a number of very different interpretations. It has been proposed that the conceptual problems of the quantum theory could be, if not resolved, at least mitigated by a proper interpretation of probability. We rather show, through a historical and analytical overview of probability and quantum theory, that if some interpretations of the one and the other go along particularly well, none follows in a unique way.

Quantum Physics,History and Philosophy of Physics
Models of Possibilities Instead of Logic as the Basis of Human Reasoning

Johnson-Laird, P. N.

DOI: https://doi.org/10.1007/s11023-024-09662-4

IF: 5.339

2024-06-05

Minds and Machines

Abstract:The theory of mental models and its computer implementations have led to crucial experiments showing that no standard logic—the sentential calculus and all logics that include it—can underlie human reasoning. The theory replaces the logical concept of validity (the conclusion is true in all cases in which the premises are true) with necessity (conclusions describe no more than possibilities to which the premises refer). Many inferences are both necessary and valid. But experiments show that individuals make necessary inferences that are invalid, e.g., Few people ate steak or sole ; therefore, few people ate steak . Other crucial experiments show that individuals reject inferences that are not necessary but valid, e.g., He had the anesthetic or felt pain, but not both ; therefore, he had the anesthetic or felt pain, or both . Nothing in logic can justify the rejection of a valid inference: a denial of its conclusion is inconsistent with its premises, and inconsistencies yield valid inferences of any conclusions whatsoever including the one denied. So inconsistencies are catastrophic in logic. In contrast, the model theory treats all inferences as defeasible (nonmonotonic), and inconsistencies have the null model, which yields only the null model in conjunction with any other premises. So inconsistences are local. Which allows truth values in natural languages to be much richer than those that occur in the semantics of standard logics; and individuals verify assertions on the basis of both facts and possibilities that did not occur.

computer science, artificial intelligence
A Stochastic Model of Mathematics and Science

David H. Wolpert,David B. Kinney

DOI: https://doi.org/10.1007/s10701-024-00755-9

2024-04-10

Foundations of Physics

Abstract:We introduce a framework that can be used to model both mathematics and human reasoning about mathematics. This framework involves stochastic mathematical systems (SMSs), which are stochastic processes that generate pairs of questions and associated answers (with no explicit referents). We use the SMS framework to define normative conditions for mathematical reasoning, by defining a "calibration" relation between a pair of SMSs. The first SMS is the human reasoner, and the second is an "oracle" SMS that can be interpreted as deciding whether the question–answer pairs of the reasoner SMS are valid. To ground thinking, we understand the answers to questions given by this oracle to be the answers that would be given by an SMS representing the entire mathematical community in the infinite long run of the process of asking and answering questions. We then introduce a slight extension of SMSs to allow us to model both the physical universe and human reasoning about the physical universe. We then define a slightly different calibration relation appropriate for the case of scientific reasoning. In this case the first SMS represents a human scientist predicting the outcome of future experiments, while the second SMS represents the physical universe in which the scientist is embedded, with the question–answer pairs of that SMS being specifications of the experiments that will occur and the outcome of those experiments, respectively. Next we derive conditions justifying two important patterns of inference in both mathematical and scientific reasoning: (i) the practice of increasing one's degree of belief in a claim as one observes increasingly many lines of evidence for that claim, and (ii) abduction, the practice of inferring a claim's probability of being correct from its explanatory power with respect to some other claim that is already taken to hold for independent reasons.

physics, multidisciplinary
Basic Principles and Applications of Probability Theory

A.V. Skorokhod

DOI: https://doi.org/10.1007/b137401

2005-01-01

Abstract:Probability theory arose originally in connection with games of chance and then for a long time it was used primarily to investigate the credibility of testimony of witnesses in the “ethical” sciences. Nevertheless, probability has become a very powerful mathematical tool in understanding those aspects of the world that cannot be described by deterministic laws. Probability has succeeded in ?nding strict determinate relationships where chance seemed to reign and so terming them “laws of chance” combining such contrasting - tions in the nomenclature appears to be quite justi?ed. This introductory chapter discusses such notions as determinism, chaos and randomness, p- dictibility and unpredictibility, some initial approaches to formalizing r- domness and it surveys certain problems that can be solved by probability theory. This will perhaps give one an idea to what extent the theory can - swer questions arising in speci?c random occurrences and the character of the answers provided by the theory. 1. 1 The Nature of Randomness The phrase “by chance” has no single meaning in ordinary language. For instance, it may mean unpremeditated, nonobligatory, unexpected, and so on. Its opposite sense is simpler: “not by chance” signi?es obliged to or bound to (happen). In philosophy, necessity counteracts randomness. Necessity signi?es conforming to law – it can be expressed by an exact law. The basic laws of mechanics, physics and astronomy can be formulated in terms of precise quantitativerelationswhichmustholdwithironcladnecessity.
Theory of Probability. A Historical Essay

Oscar Sheynin

DOI: https://doi.org/10.48550/arXiv.1802.09966

2018-02-27

History and Overview

Abstract:This book covers the history of probability up to Kolmogorov with essential additional coverage of statistics up to Fisher. Based on my work of ca. 50 years, it is the only suchlike book. Gorrochurn (2016) is similar but his study of events preceding Laplace is absolutely unsatisfactory. Hald (1990; 1998) are worthy indeed but the Continental direction of statistics (Russian and German statisticians) is omitted, it is impossible to find out what was contained in any particular memoir of Laplace and the explanation does not always explain the path from, say, Poisson to a modern interpretation of his results. Finally, the reader ought to master modern math. statistics. I included many barely known facts and conclusions, e. g., Gauss' justification of least squares (yes!), the merits of Bayes (again, yes!), the unforgivable mistake of Laplace, the work of Chebyshev and his students (merits and failures) etc., etc. The book covers an extremely wide field, and is targeted at the same readers as any other book on history of science. Mathematical treatment is not as difficult as it is for readers of Hald.
Modified associate formalism without entropy paradox: Part II. Comparison with similar models

Dmitry N. Saulov,A. Y. Klimenko

DOI: https://doi.org/10.1016/j.jallcom.2008.06.021

2013-01-15

Abstract:The modified associate formalism is compared with similar models, such as the classical associate model, the associate species model and the modified quasichemical model. Advantages of the modified associate formalism are demonstrated.

Other Condensed Matter,Statistical Mechanics
Quantum Mechanics with Extended Probabilities

James B. Hartle

DOI: https://doi.org/10.1103/PhysRevA.78.012108

2008-07-18

Abstract:The quantum mechanics of closed systems such as the universe is formulated using an extension of familiar probability theory that incorporates negative probabilities. Probabilities must be positive for sets of alternative histories that are the basis of fair settleable bets. However, in quantum mechanics there are sets of alternative histories that can be described but which cannot be the basis for fair settleable bets. Members of such sets can be assigned extended probabilities that are sometimes negative. A prescription for extended probabilities is introduced that assigns extended probabilities to all histories that can be described, fine grained or coarse grained, members of decoherent sets or not. All probability sum rules are satisfied exactly. Sets of histories that are recorded to sufficient precision are the basis of settleable bets. This formulation is compared with the decoherent (consistent) histories formulation of quantum theory. Prospects are discussed for using this formulation to provide testable alternatives to quantum theory or further generalizations of it.

Quantum Physics,General Relativity and Quantum Cosmology,High Energy Physics - Theory
Are models our tools not our masters?

Caspar Jacobs

DOI: https://doi.org/10.1007/s11229-023-04352-7

IF: 1.595

2023-10-10

Synthese

Abstract:It is often claimed that one can avoid the kind of underdetermination that is a typical consequence of symmetries in physics by stipulating that symmetry-related models represent the same state of affairs (Leibniz Equivalence). But recent commentators (Dasgupta in Philos Perspect 25:115–160, 2011; Pooley in: Knox and Wilson (eds) The Routledge companion to the philosophy of physics, Routledge, Milton Park, 2021; Pooley and Read in Br J Philos Sci, 2021, https://doi.org/10.1086/718274; Teitel in J Philos 119:233–278, 2021) have responded that claims about the representational capacities of models are irrelevant to the issue of underdetermination, which concerns possible worlds themselves. In this paper I distinguish two versions of this objection: (1) that a theory's formalism does not (fully) determine the space of physical possibilities, and (2) that the relevant notion of possibility is not physical possibility. I offer a refutation of each.

history & philosophy of science
Foundations of abstract probability theory

Yurii Yurchenko

DOI: https://doi.org/10.48550/arXiv.2110.02009

2021-10-05

Probability

Abstract:Using the ideas of abstract algebra, we introduce the basic concepts of abstract probability theory that generalize the Kolmogorov's probability theory, possibility theory and other theories that deal with uncertainty. Based on abstract addition and multiplication, we define an abstract measure and abstract Lebesgue integral. System of Kolmogorov's axioms is criticized, after which we introduce an abstract probability measure and abstract conditional probability, show that they have recognizable probability properties. In addition, we define an abstract expected value operator as the abstract Lebesgue integral and prove its properties.

Probability theory and its models

Imprecise Probabilities From Imprecise Descriptions Of Real Numbers

Extended Probabilities: Mathematical Foundations

Phantom Probability

Free probability for probabilists

Methods of free probability

Theory of Probability. An Elementary Treatise against a Historical Background

Probability as a Modal Operator

Physics with exotic probability theory

Model theoretic events

Possibility Theory and Its Applications: Where Do We Stand?

Harold Jeffreys's Theory of Probability Revisited

On the relation between quantum theory and probability

Models of Possibilities Instead of Logic as the Basis of Human Reasoning

A Stochastic Model of Mathematics and Science

Basic Principles and Applications of Probability Theory

Theory of Probability. A Historical Essay

Modified associate formalism without entropy paradox: Part II. Comparison with similar models

Quantum Mechanics with Extended Probabilities

Are models our tools not our masters?

Foundations of abstract probability theory