Abstract:Analyzing probabilistic programs and randomized algorithms are classical problems in computer science. The first basic problem in the analysis of stochastic processes is to consider the expectation or mean, and another basic problem is to consider concentration bounds, i.e. showing that large deviations from the mean have small probability. Similarly, in the context of probabilistic programs and randomized algorithms, the analysis of expected termination time/running time and their concentration bounds are fundamental <a class="link-external link-http" href="http://problems.In" rel="external noopener nofollow">this http URL</a> this work, we focus on concentration bounds for probabilistic programs and probabilistic recurrences of randomized algorithms. For probabilistic programs, the basic technique to achieve concentration bounds is to consider martingales and apply the classical Azuma's inequality. For probabilistic recurrences of randomized algorithms, Karp's classical "cookbook" method, which is similar to the master theorem for recurrences, is the standard approach to obtain concentration bounds. In this work, we propose a novel approach for deriving concentration bounds for probabilistic programs and probabilistic recurrence relations through the synthesis of exponential supermartingales. For probabilistic programs, we present algorithms for synthesis of such supermartingales in several cases. We also show that our approach can derive better concentration bounds than simply applying the classical Azuma's inequality over various probabilistic programs considered in the literature. For probabilistic recurrences, our approach can derive tighter bounds than the Karp's well-established methods on classical algorithms. Moreover, we show that our approach could derive bounds comparable to the optimal bound for quicksort, proposed by McDiarmid and Hayward. We also present a prototype implementation that can automatically infer these bounds

Lexicographic Ranking Supermartingales with Lazy Lower Bounds

Lexicographic ranking supermartingales: an efficient approach to termination of probabilistic programs

The Law of the Iterated Logarithm for Character Ratios

Ranking and Repulsing Supermartingales for Reachability in Probabilistic Programs

Stochastic Omega-Regular Verification and Control with Supermartingales

Lindeberg's Central Limit Theorems for Martingale-Like Sequences under Sub-Linear Expectations

Functional Shige Peng’s Central Limit Theorems for Martingale Vectors

Inference-time Stochastic Ranking with Risk Control

Improving Zero-shot LLM Re-Ranker with Risk Minimization

Algorithmic Analysis of Termination Problems for Quantum Programs.

Reranking Laws for Language Generation: A Communication-Theoretic Perspective

Sublinear Expectations and Martingales in discrete time

Square Functions for Noncommutative Differentially Subordinate Martingales

Old and new joint characterizations of leximin and variants of rank-weighted utilitarianism

R 2 : A Novel Recall & Ranking Framework for Legal Judgment Prediction

Positive Semidefinite Supermartingales and Randomized Matrix Concentration Inequalities

Generalization Analysis of Listwise Learning-to-rank Algorithms

LLM-RankFusion: Mitigating Intrinsic Inconsistency in LLM-based Ranking

Breaking the Mold: Nonlinear Ranking Function Synthesis Without Templates

Concentration-Bound Analysis for Probabilistic Programs and Probabilistic Recurrence Relations

Lower Bounds for Possibly Divergent Probabilistic Programs.