Abstract:Bayesian inference requires specification of a single, precise prior distribution, whereas frequentist inference only accommodates a vacuous prior. Since virtually every real-world application falls somewhere in between these two extremes, a new approach is needed. This series of papers develops a new framework that provides valid and efficient statistical inference, prediction, etc., while accommodating partial prior information and imprecisely-specified models more generally. This paper fleshes out a general inferential model construction that not only yields tests, confidence intervals, etc.~with desirable error rate control guarantees, but also facilitates valid probabilistic reasoning with de~Finetti-style no-sure-loss guarantees. The key technical novelty here is a so-called outer consonant approximation of a general imprecise probability which returns a data- and partial prior-dependent possibility measure to be used for inference and prediction. Despite some potentially unfamiliar imprecise-probabilistic concepts in the development, the result is an intuitive, likelihood-driven framework that will, as expected, agree with the familiar Bayesian and frequentist solutions in the respective extreme cases. More importantly, the proposed framework accommodates partial prior information where available and, therefore, leads to new solutions that were previously out of reach for both Bayesians and frequentists. Details are presented here for a wide range of examples, with more practical details to come in later installments.

A Precise Information Flow Measure from Imprecise Probabilities

An Improved Belief Entropy and Its Application in Decision-Making

A Modified Belief Entropy in Dempster-Shafer Framework

Symbolic Quantitative Information Flow for Probabilistic Programs

Imprecise Probabilities From Imprecise Descriptions Of Real Numbers

Hybrid Statistical Estimation of Mutual Information and its Application to Information Flow

Refining a Quantitative Information Flow Metric

Comparison Of Measuring Information Leakage For Fully Probabilistic Systems

Algebraic Foundations for Information Theoretical, Probabilistic and Guessability measures of Information Flow

On bounding problems of quantitative information flow

Combining information from independent sources through confidence distributions

Quantifying Dynamic Leakage: Complexity Analysis and Model Counting-based Calculation

Shannon Revisited: Considering a More Tractable Expression to Measure and Manage Intractability, Uncertainty, Risk, Ignorance, and Entropy

Compositional imprecise probability

Valid and efficient imprecise-probabilistic inference with partial priors, II. General framework

Plausibility Extropy: The Complementary Dual of Plausibility Entropy

On Information-Theoretic Measures of Predictive Uncertainty

Scalable Information-Flow Analysis of Secure Three-Party Affine Computations

A Generalization of Axiomatic Approach to Information Leakage

Differential Privacy versus Quantitative Information Flow

Explicit Formula for Partial Information Decomposition