Abstract:Analyzing probabilistic programs and randomized algorithms are classical problems in computer science. The first basic problem in the analysis of stochastic processes is to consider the expectation or mean, and another basic problem is to consider concentration bounds, i.e. showing that large deviations from the mean have small probability. Similarly, in the context of probabilistic programs and randomized algorithms, the analysis of expected termination time/running time and their concentration bounds are fundamental <a class="link-external link-http" href="http://problems.In" rel="external noopener nofollow">this http URL</a> this work, we focus on concentration bounds for probabilistic programs and probabilistic recurrences of randomized algorithms. For probabilistic programs, the basic technique to achieve concentration bounds is to consider martingales and apply the classical Azuma's inequality. For probabilistic recurrences of randomized algorithms, Karp's classical "cookbook" method, which is similar to the master theorem for recurrences, is the standard approach to obtain concentration bounds. In this work, we propose a novel approach for deriving concentration bounds for probabilistic programs and probabilistic recurrence relations through the synthesis of exponential supermartingales. For probabilistic programs, we present algorithms for synthesis of such supermartingales in several cases. We also show that our approach can derive better concentration bounds than simply applying the classical Azuma's inequality over various probabilistic programs considered in the literature. For probabilistic recurrences, our approach can derive tighter bounds than the Karp's well-established methods on classical algorithms. Moreover, we show that our approach could derive bounds comparable to the optimal bound for quicksort, proposed by McDiarmid and Hayward. We also present a prototype implementation that can automatically infer these bounds

On Probabilistic Analysis of Randomization in Hybrid Symbolic-Numeric Algorithms

On Exact and Approximate Interpolation of Sparse Rational Functions

Sparse Multivariate Function Recovery with a High Error Rate in the Evaluations.

Reducing Randomness Via Irrational Numbers

Sparse Multivariate Function Recovery with a Small Number of Evaluations.

Sparse multivariate function recovery from values with noise and outlier errors

Fast estimates of Hankel matrix condition numbers and numeric sparse interpolation

Asymptotic Analysis of Sampling Estimators for Randomized Numerical Linear Algebra Algorithms

Analysis of eigenvalue condition numbers for a class of randomized numerical methods for singular matrix pencils

Proving Total Correctness and Generating Preconditions for Loop Programs Via Symbolic-Numeric Computation Methods

Revisit Sparse Polynomial Interpolation Based on Randomized Kronecker Substitution

Concentration-Bound Analysis for Probabilistic Programs and Probabilistic Recurrence Relations

Randomized matrix-free quadrature: unified and uniform bounds for stochastic Lanczos quadrature and the kernel polynomial method

The Synthesis of Stochastic Logic to Perform Multivariate Polynomial Arithmetic

Generating Exact Nonlinear Ranking Functions by Symbolic-Numeric Hybrid Method

Error Analysis of Sum-Product Algorithms under Stochastic Rounding

A Probabilistic Approach to Floating-Point Arithmetic

Rigorous Roundoff Error Analysis of Probabilistic Floating-Point Computations

Rational Empirical Interpolation Methods with Applications

Multivariate sparse interpolation using randomized Kronecker substitutions

The Synthesis of Robust Polynomial Arithmetic with Stochastic Logic