Abstract:Stochastic approximation algorithms have been the subject of an enormous body of literature, both theoretical and applied. Recently, Laruelle and Pag\`es (2013) presented a link between the stochastic approximation and response-adaptive designs in clinical trials based on randomized urn models investigated in Bai and Hu (1999, 2005), and derived the asymptotic normality or central limit theorem for the normalized procedure using a central limit theorem for the stochastic approximation algorithm. However, the classical central limit theorem for the stochastic approximation algorithm does not include all cases of its regression function, creating a gap between the results of Laruelle and Pag\`es (2013) and those of Bai and Hu (2005) for randomized urn models. In this paper, we establish new central limit theorems of the stochastic approximation algorithm under the popular Lindeberg condition to fill this gap. Moreover, we prove that the process of the algorithms can be approximated by a Gaussian process that is a solution of a stochastic differential equation. In our application, we investigate a more involved family of urn models and related adaptive designs in which it is possible to remove the balls from the urn, and the expectation of the total number of balls updated at each stage is not necessary a constant. The asymptotic properties are derived under much less stringent assumptions than those in Bai and Hu (1999, 2005) and Laruelle and Pag\`es (2013).

Strong Approximations of Martingale Vectors and Their Applications in Markov-Chain Adaptive Designs

STRONG APPROXIMATION OF A MARKOV CHAIN

Strong Approximation of Locally Square-Integrable Martingales

Strong Approximation for A Class of Stationary Processes

Strong Approximation for Moving Average Processes under Dependence Assumptions

Functional Shige Peng’s Central Limit Theorems for Martingale Vectors

Approximation of martingale couplings on the line in the weak adapted topology

ASYMPTOTIC PROPERTIES OF ADAPTIVE DESIGNS VIA STRONG APPROXIMATIONS

Approximation of martingale couplings on the line in the adapted weak topology

Lindeberg's Central Limit Theorems for Martingale-Like Sequences under Sub-Linear Expectations

Central Limit Theorems of a Recursive Stochastic Algorithm with Applications to Adaptive Designs

Weak approximation of martingale representations

Limit Theorems for quadratic forms of Markov Chains

The fundamental martingale with applications to Markov Random Fields

Conditioning of Banach Space Valued Gaussian Random Variables: An Approximation Approach Based on Martingales

An invitation to adaptive Markov chain Monte Carlo convergence theory

Deviation inequalities for martingales with applications to linear regressions and weak invariance principles

Martingale approximation of non-stationary stochastic processes

Asymptotics for parametric martingale posteriors

Rate-optimal estimation of mixed semimartingales

On martingale approximation of adapted processes