Abstract:We present an optimization-based framework to construct confidence intervals for functionals in constrained inverse problems, ensuring valid one-at-a-time frequentist coverage guarantees. Our approach builds upon the now-called strict bounds intervals, originally pioneered by Burrus (1965) and Rust and Burrus (1972), which offer ways to directly incorporate any side information about the parameters during inference without introducing external biases. This family of methods allows for uncertainty quantification in ill-posed inverse problems without needing to select a regularizing prior. By tying optimization-based intervals to an inversion of a constrained likelihood ratio test, we translate interval coverage guarantees into type I error control and characterize the resulting interval via solutions to optimization problems. Along the way, we refute the Burrus conjecture, which posited that, for possibly rank-deficient linear Gaussian models with positivity constraints, a correction based on the quantile of the chi-squared distribution with one degree of freedom suffices to shorten intervals while maintaining frequentist coverage guarantees. Our framework provides a novel approach to analyzing the conjecture, and we construct a counterexample employing a stochastic dominance argument, which we also use to disprove a general form of the conjecture. We illustrate our framework with several numerical examples and provide directions for extensions beyond the Rust-Burrus method for nonlinear, non-Gaussian settings with general constraints.

Rigorous confidence intervals for critical probabilities

Asymptotic Behavior of the Critical Probability for Ρ-Percolation in High Dimensions

On randomized confidence intervals for the binomial probability

Binomial Confidence Intervals for Rare Events: Importance of Defining Margin of Error Relative to Magnitude of Proportion

Generalised Clopper–Pearson confidence intervals for the binomial proportion

Probability calculations under the IAC hypothesis

Technical Communique: On the binomial confidence interval and probabilistic robust control

Assessing the coverage probabilities of fixed-margin confidence intervals for the tail conditional allocation

Bounding rare event probabilities in computer experiments

Estimating means of bounded random variables by betting

On Finding the Upper Confidence Limit for a Binomial Proportion when Zero Successes are Observed

Probability Proofs for Stirling (and More): the Ubiquitous Role of $\mathbf{\sqrt{2π}}$

On Confidence Sequences for Bounded Random Processes via Universal Gambling Strategies

Uncertainty Quantification and Confidence Intervals for Naive Rare-Event Estimators

Optimization-based frequentist confidence intervals for functionals in constrained inverse problems: Resolving the Burrus conjecture

Strict inequality for the chemical distance exponent in two-dimensional critical percolation

An importance sampling method for Feldman-Cousins confidence intervals

Tighter Confidence Intervals for Rating Systems

Critical Behavior of the Stochastic SIR Model on Random Bond-Diluted Lattices