Abstract:In Bayesian probabilistic programming, a central problem is to estimate the normalised posterior distribution (NPD) of a probabilistic program with conditioning via score (a.k.a. observe) statements. Most previous approaches address this problem by Markov Chain Monte Carlo and variational inference, and therefore could not generate guaranteed outcomes within a finite time limit. Moreover, existing methods for exact inference either impose syntactic restrictions or cannot guarantee successful inference in general. In this work, we propose a novel automated approach to derive guaranteed bounds for NPD via polynomial solving. We first establish a fixed-point theorem for the wide class of score-at-end Bayesian probabilistic programs that terminate almost-surely and have a single bounded score statement at program termination. Then, we propose a multiplicative variant of Optional Stopping Theorem (OST) to address score-recursive Bayesian programs where score statements with weights greater than one could appear inside a loop. Finally, we use polynomial solving to implement our fixed-point theorem and OST variant. To improve the accuracy of the polynomial solving, we further propose a truncation operation and the synthesis of multiple bounds over various program inputs. Our approach can handle Bayesian probabilistic programs with unbounded while loops and continuous distributions with infinite supports. Experiments over a wide range of benchmarks show that compared with the most relevant approach (Beutner et al., PLDI 2022) for guaranteed NPD analysis via recursion unrolling, our approach is more time efficient and derives comparable or even tighter NPD bounds. Furthermore, our approach can handle score-recursive programs which previous approaches could not.

Solving unconstrained binary polynomial programs with limited reach: Application to low autocorrelation binary sequences

Quadratic unconstrained binary optimization problem preprocessing: Theory and empirical analysis

Polynomially Solvable Cases Of Binary Quadratic Programs

Revisiting some classical linearizations of the quadratic binary optimization problem

Static Posterior Inference of Bayesian Probabilistic Programming via Polynomial Solving

Solving the Binary Linear Programming Model in Polynomial Time

A Nearly-Linear Time Algorithm for Linear Programs with Small Treewidth: A Multiscale Representation of Robust Central Path

Robust Approximation to Chance-Constrained Binary Programming Using Non-Parametric Density Information

A Vectorized Positive Semidefinite Penalty Method for Unconstrained Binary Quadratic Programming

Boosting quantum annealing performance through direct polynomial unconstrained binary optimization

Discrete Dynamical System Approaches for Boolean Polynomial Optimization

On some features of Quadratic Unconstrained Binary Optimization with random coefficients

Polynomial Time Algorithms for Integer Programming and Unbounded Subset Sum in the Total Regime

A Knowledge Compilation Take on Binary Polynomial Optimization

Binary Optimization via Mathematical Programming with Equilibrium Constraints

Univariate representations of solutions to generic polynomial complementarity problems

A New Computational Approach for Solving Linear Bilevel Programs Based on Parameter-Free Disjunctive Decomposition

A New Parallel Cooperative Landscape Smoothing Algorithm and Its Applications on TSP and UBQP

Asynchronous Algorithms for Solving Linear Programs

A multi-objective tabu search algorithm based on decomposition for multi-objective unconstrained binary quadratic programming problem

Solving Quadratic Unconstrained Binary Optimization with divide-and-conquer and quantum algorithms