Abstract:We establish strong consistency (i.e., almost sure convergence) of infinitesimal perturbation analysis (IPA) estimators of derivatives of steady-state means for a broad class of systems. Our results substantially extend previously available results on steady-state derivative estimation via IPA.Our basic assumption is that the process under study is regenerative, but our analysis uses regenerative structure in an indirect way: IPA estimators are typically biased over regenerative cycles, so straightforward differentiation of the regenerative ratio formula does not necessarily yield a valid estimator of the derivative of a steady-state mean. Instead, we use regeneration to pass from unbiasedness over fixed, finite time horizons to convergence as the time horizon grows. This provides a systematic way of extending results on unbiasedness to strong consistency.Given that the underlying process regenerates, we provide conditions under which a certain augmented process is also regenerative. The augmented process includes additional information needed to evaluate derivatives; derivatives of time averages of the original process are time averages of the augmented process. Thus, through this augmentation we are able to apply standard renewal theory results to the convergence of derivatives.

On Comparison of Steady-State Infinitesimal Perturbation Analysis and Likelihood Ratio Derivative Estimates.

Consistency of infinitesimal perturbation analysis estimators with rates

Steady-state Sample Path Derivative Estimators

Comparison of Gradient Estimation Techniques for Queues with Non-Identical Servers.

Bias Properties Of Infinitesimal Perturbation Analysis For Multiserver Queues

Bias Properties Of Infinitesimal Perturbation Analysis For Systems With Parallel Servers

Convexity of sample path performance and strong consistency of infinitesimal perturbation analysis estimates

An Infinitesimal Perturbation Analysis Algorithm For A Multiclass G/G/1 Queue

Strong Consistency of Infinitesimal Perturbation Analysis for Networks with Correlated Service Times

Differentiability and Analyticity of Queues in Light Traffic

Consistency of infinitesimal perturbation analysis for the GI/G/m queue

Strongly Consistent Steady-State Derivative Estimates

Smoothed Perturbation Analysis Derivative Estimation For Markov-Chains

Variance Properties of Second Derivative Perturbation Analysis Estimators for Single-Server Queues

On the Variance of Single-Run Unbiased Stochastic Derivative Estimators.

Regenerative Rare Events Simulation Via Likelihood Ratios

Strong Consistency of Infinitesimal Perturbation Analysis for Tandem Queueing Networks

Performance Gradient Estimation for M/G/1 Queueing System Using Nonstandard Analysis

Augmented Infinitesimal Perturbation Analysis: an Alternate Explanation

Strong Consistency Of Sample Path Derivative Estimates

Perturbation Analysis of a Dynamic Priority Call Center