Abstract:We establish strong consistency (i.e., almost sure convergence) of infinitesimal perturbation analysis (IPA) estimators of derivatives of steady-state means for a broad class of systems. Our results substantially extend previously available results on steady-state derivative estimation via IPA.Our basic assumption is that the process under study is regenerative, but our analysis uses regenerative structure in an indirect way: IPA estimators are typically biased over regenerative cycles, so straightforward differentiation of the regenerative ratio formula does not necessarily yield a valid estimator of the derivative of a steady-state mean. Instead, we use regeneration to pass from unbiasedness over fixed, finite time horizons to convergence as the time horizon grows. This provides a systematic way of extending results on unbiasedness to strong consistency.Given that the underlying process regenerates, we provide conditions under which a certain augmented process is also regenerative. The augmented process includes additional information needed to evaluate derivatives; derivatives of time averages of the original process are time averages of the augmented process. Thus, through this augmentation we are able to apply standard renewal theory results to the convergence of derivatives.

Aggregation of simulation and infinitesimal perturbation analysis in discrete event dynamic system

Performance Regulation of Event-Driven Dynamical Systems Using Infinitesimal Perturbation Analysis

Augmented Infinitesimal Perturbation Analysis: an Alternate Explanation

GSMP formalism and perturbation analysis for discrete event dynamic systems

Discontinuous Perturbation Analysis of Discrete-Event Dynamic Systems

Parametric analysis of differential evolution algorithm applied to water distribution system optimization

Bias Properties Of Infinitesimal Perturbation Analysis For Systems With Parallel Servers

Performance Gradient Estimation for M/G/1 Queueing System Using Nonstandard Analysis

Algorithm for Performance Sensitivity Estimation of Markov Discrete Event Dynamic System

Steady-state Sample Path Derivative Estimators

IPA in the Loop: Control Design for Throughput Regulation in Computer Processors

Study of calculating the dynamic available transfer capability with the differential evolution algorithm

An Infinitesimal Perturbation Analysis Algorithm For A Multiclass G/G/1 Queue

Strong Consistency Of Sample Path Derivative Estimates

A Distributed Simultaneous Perturbation Approach for Large-Scale Dynamic Optimization Problems.

Strongly Consistent Steady-State Derivative Estimates

Convexity of sample path performance and strong consistency of infinitesimal perturbation analysis estimates

Consistency of infinitesimal perturbation analysis estimators with rates

Congestion management in traffic-light intersections via Infinitesimal Perturbation Analysis

Enhancement of Parameter-Estimation Precision in Noisy Systems by Dynamical Decoupling Pulses

Sample path properties of the G/D/m queue