Abstract:Analyzing probabilistic programs and randomized algorithms are classical problems in computer science. The first basic problem in the analysis of stochastic processes is to consider the expectation or mean, and another basic problem is to consider concentration bounds, i.e. showing that large deviations from the mean have small probability. Similarly, in the context of probabilistic programs and randomized algorithms, the analysis of expected termination time/running time and their concentration bounds are fundamental <a class="link-external link-http" href="http://problems.In" rel="external noopener nofollow">this http URL</a> this work, we focus on concentration bounds for probabilistic programs and probabilistic recurrences of randomized algorithms. For probabilistic programs, the basic technique to achieve concentration bounds is to consider martingales and apply the classical Azuma's inequality. For probabilistic recurrences of randomized algorithms, Karp's classical "cookbook" method, which is similar to the master theorem for recurrences, is the standard approach to obtain concentration bounds. In this work, we propose a novel approach for deriving concentration bounds for probabilistic programs and probabilistic recurrence relations through the synthesis of exponential supermartingales. For probabilistic programs, we present algorithms for synthesis of such supermartingales in several cases. We also show that our approach can derive better concentration bounds than simply applying the classical Azuma's inequality over various probabilistic programs considered in the literature. For probabilistic recurrences, our approach can derive tighter bounds than the Karp's well-established methods on classical algorithms. Moreover, we show that our approach could derive bounds comparable to the optimal bound for quicksort, proposed by McDiarmid and Hayward. We also present a prototype implementation that can automatically infer these bounds

ON PROBABILISTIC CONVERGENCE RATES OF STOCHASTIC BERNSTEIN POLYNOMIALS

On Bernstein Type Inequalities for Stochastic Integrals of Multivariate Point Processes

A Supplement to the Complete Convergence

CHEBYSHEV TYPE INEQUALITY FOR STOCHASTIC BERNSTEIN POLYNOMIALS

Polynomial Convergence Order of Stochastic Bernstein Approximation.

Uniform approximation and Bernstein polynomials with coefficients in the unit interval

Convergence Rates of Spectral Distributions of Large Sample Covariance Matrices

On the rates of pointwise convergence for Bernstein polynomials

Bernstein approximation and beyond: proofs by means of elementary probability theory

Sampling scattered data with Bernstein polynomials: stochastic and deterministic error estimates

On the convergence of probabilities of the random graphs' properties expressed by first-order formulae with a bounded quantifier depth

Strichartz estimates for orthonormal functions and probabilistic convergence of density functions of compact operators on manifolds

Mod-φ convergence of Stirling distributions and limit theorems for zeros of their generating functions

Bernstein -- von Mises theorems for statistical inverse problems II: Compound Poisson processes

Lipschitz Interpolation: Non-parametric Convergence under Bounded Stochastic Noise

Exponential Concentration in Stochastic Approximation

Wasserstein-p Bounds in the Central Limit Theorem Under Local Dependence

Concentration-Bound Analysis for Probabilistic Programs and Probabilistic Recurrence Relations

Some Results on the Lp-convergence (p⩾1) of U-statistics

On Inhomogeneous Infinite Products of Stochastic Matrices and Applications

Strong convergence in the infinite horizon of numerical methods for stochastic differential equations