Abstract:Analyzing probabilistic programs and randomized algorithms are classical problems in computer science. The first basic problem in the analysis of stochastic processes is to consider the expectation or mean, and another basic problem is to consider concentration bounds, i.e. showing that large deviations from the mean have small probability. Similarly, in the context of probabilistic programs and randomized algorithms, the analysis of expected termination time/running time and their concentration bounds are fundamental <a class="link-external link-http" href="http://problems.In" rel="external noopener nofollow">this http URL</a> this work, we focus on concentration bounds for probabilistic programs and probabilistic recurrences of randomized algorithms. For probabilistic programs, the basic technique to achieve concentration bounds is to consider martingales and apply the classical Azuma's inequality. For probabilistic recurrences of randomized algorithms, Karp's classical "cookbook" method, which is similar to the master theorem for recurrences, is the standard approach to obtain concentration bounds. In this work, we propose a novel approach for deriving concentration bounds for probabilistic programs and probabilistic recurrence relations through the synthesis of exponential supermartingales. For probabilistic programs, we present algorithms for synthesis of such supermartingales in several cases. We also show that our approach can derive better concentration bounds than simply applying the classical Azuma's inequality over various probabilistic programs considered in the literature. For probabilistic recurrences, our approach can derive tighter bounds than the Karp's well-established methods on classical algorithms. Moreover, we show that our approach could derive bounds comparable to the optimal bound for quicksort, proposed by McDiarmid and Hayward. We also present a prototype implementation that can automatically infer these bounds

An algorithm for simplified recurrence analysis

Trends in recurrence analysis of dynamical systems

Efficient Spectral-Aware Power Supply Noise Analysis for Low-Power Design Verification

Central Limit Theorems of a Recursive Stochastic Algorithm with Applications to Adaptive Designs

Exploring recursive properties and dynamical complexity in scalar time-series using threshold-free recursive analysis approach

Convergence Analysis of Asynchronous Stochastic Recursive Gradient Algorithms

An Order Theory Framework of Recurrence Equations for Static Cost Analysis $-$ Dynamic Inference of Non-Linear Inequality Invariants

Automated Tail Bound Analysis for Probabilistic Recurrence Relations.

Recurrence Based Nonlinear Analysis for Network Application Traffic

New Approach for Robust Stability Analysis of Delayed Recurrent Neural Networks

Challenges and perspectives in recurrence analyses of event time series

A model-free characterization of recurrences in stationary time series

A THEORETICAL ANALYSIS OF RECIPROCAL ITERATIVE ALGORITHM AND A DISCUSSION OF ITS SCHEMES

Solving Recurrence Relations using Machine Learning, with Application to Cost Analysis

Concentration-Bound Analysis for Probabilistic Programs and Probabilistic Recurrence Relations

Symbolic Recurrence Quantification Analysis and Its Application

Recurrent event analysis in the presence of real-time high frequency data via random subsampling

Efficient Algorithms and Error Analysis for the Modified Nystrom Method.

A Piecewise Approach for the Analysis of Exact Algorithms

Iterative-free Program Analysis

Analysis of Re-entrant Lines: An Iterative Approach