Abstract:The paper deals with concentration inequalities for locally small increments of compound empirical processes. In the asymptotic theory of $m$-estimation such inequalities play an essential role in deriving convergence rates for solutions of the sample average approximation method to solve compound stochastic programs, and in particular for $m$-estimators. We develop inequalities dependent on the sample sizes with explicit terms instead of unspecified universal constants. They are applied to study the Sample Average Approximation method for compound stochastic programs. Nonasymptotic upper estimates for the deviation probabilities of the optimal solutions are derived which are dependent on the sample sizes. They allow to conclude immediately convergence rates for the optimal solutions. In the special case of classical risk neutral stochastic programs, we end up with upper estimates of deviation probabilities for $m$-estimators, and their convergence rates. Moreover, we may also demonstrate how to apply the results to sample average approximation of risk averse stochastic programs. In this respect we consider stochastic programs expressed in terms of absolute semideviations and Average Value at Risk. The investigations are based on concentration inequalities from the recent contribution Kratschmer(2024).

Concentration Inequalities and Laws of Large Numbers under Epistemic Irrelevance

Strong Limit Theorems for Extended Independent Random Variables and Extended Negatively Dependent Random Variables under Sub-Linear Expectations

The Sufficient and Necessary Conditions of the Strong Law of Large Numbers under Sub-Linear Expectations

Marcinkiewicz's Strong Law of Large Numbers for Nonlinear Expectations

Rosenthal’s Inequalities for Independent and Negatively Dependent Random Variables under Sub-Linear Expectations with Applications

Exponential inequalities under the sub-linear expectations with applications to laws of the iterated logarithm

Concentration Inequalities for Statistical Inference

Lindeberg's Central Limit Theorems for Martingale-Like Sequences under Sub-Linear Expectations

Stability for the Brunn-Minkowski and Riesz Rearrangement Inequalities, with Applications to Gaussian Concentration and Finite Range Non-local Isoperimetry

Constructive approaches to concentration inequalities with independent random variables

On the Concentration of the Minimizers of Empirical Risks

The Limit Points of the Strong Law of Large Numbers under the Sub-Linear Expectations

Concentration inequalities for locally small increments of compound empirical processes with applications to solutions of compound and risk averse stochastical programming

Three Series Theorem for Independent Random Variables under Sub-linear Expectations with Applications

Matrix Concentration Inequalities and Free Probability II. Two-sided Bounds and Applications

Concentration of measure and spectra of random matrices: Applications to correlation matrices, elliptical distributions and beyond

Laws of Large Numbers for Continuous Belief Measures on Compact Spaces

Large deviations and concentration inequalities for the Ornstein-Uhlenbeck process without tears

Central Limit Theorem with Exchangeable Summands and Mixtures of Stable Laws as Limits

Marcinkiewicz's strong law of large numbers for non-additive expectation

Positive Semidefinite Supermartingales and Randomized Matrix Concentration Inequalities