Abstract:In statistical inference, uncertainty is unknown and all models are wrong. That is to say, a person who makes a statistical model and a prior distribution is simultaneously aware that both are fictional candidates. To study such cases, statistical measures have been constructed, such as cross validation, information criteria and marginal likelihood; however, their mathematical properties have not yet been completely clarified when statistical models are under- or over-parametrized. We introduce a place of mathematical theory of Bayesian statistics for unknown uncertainty, which clarifies general properties of cross validation, information criteria and marginal likelihood, even if an unknown data-generating process is unrealizable by a model or even if the posterior distribution cannot be approximated by any normal distribution. Hence it gives a helpful standpoint for a person who cannot believe in any specific model and prior. This paper consists of three parts. The first is a new result, whereas the second and third are well-known previous results with new experiments. We show there exists a more precise estimator of the generalization loss than leave-one-out cross validation, there exists a more accurate approximation of marginal likelihood than Bayesian information criterion, and the optimal hyperparameters for generalization loss and marginal likelihood are different. This article is part of the theme issue ‘Bayesian inference: challenges, perspectives, and prospects’.

Bayesian Decision Theory and Stochastic Independence

Decision-making Under Ordinal Preferences and Comparative Uncertainty

An outline of the Bayesian decision theory

A Rank-Dependent Theory for Decision under Risk and Ambiguity

Conditional Independence in Uncertainty Theories

Non-Classical Expected Utility Theory

Statistical Decision Theory Respecting Stochastic Dominance

Better Foundations for Subjective Probability

Decisions Under Uncertainty as Bayesian Inference on Choice Options

Inconsistency and Acausality in Bayesian Inference for Physical Problems

Exceeding Expectations: Stochastic Dominance as a General Decision Theory

Mathematical theory of Bayesian statistics for unknown information source

Rigid characterizations of probability measures through independence, with applications

A Bayesian Account of Quantum Histories

Mixture independence foundations for expected utility

Risk, ambiguity and quantum decision theory

Bayesian Persuasion With Complementary Information

Equivalence of Stochastic and Deterministic Mechanisms

Decision-Making Under Uncertainty: Beyond Probabilities

Dependence and Relevance: A probabilistic view

Multivariate Almost Stochastic Dominance: Transfer Characterizations and Sufficient Conditions Under Dependence Uncertainty