Abstract:Stochastic approximation algorithms have been the subject of an enormous body of literature, both theoretical and applied. Recently, Laruelle and Pag\`es (2013) presented a link between the stochastic approximation and response-adaptive designs in clinical trials based on randomized urn models investigated in Bai and Hu (1999, 2005), and derived the asymptotic normality or central limit theorem for the normalized procedure using a central limit theorem for the stochastic approximation algorithm. However, the classical central limit theorem for the stochastic approximation algorithm does not include all cases of its regression function, creating a gap between the results of Laruelle and Pag\`es (2013) and those of Bai and Hu (2005) for randomized urn models. In this paper, we establish new central limit theorems of the stochastic approximation algorithm under the popular Lindeberg condition to fill this gap. Moreover, we prove that the process of the algorithms can be approximated by a Gaussian process that is a solution of a stochastic differential equation. In our application, we investigate a more involved family of urn models and related adaptive designs in which it is possible to remove the balls from the urn, and the expectation of the total number of balls updated at each stage is not necessary a constant. The asymptotic properties are derived under much less stringent assumptions than those in Bai and Hu (1999, 2005) and Laruelle and Pag\`es (2013).

Asymptotic Normality of Maximum Quasi-Likelihood Estimators in Generalized Linear Models with Fixed Design

Weak consistency and asymptotic normality of quasi-maximum likelihood estimates in generalized linear models

Strong Consistency of Maximum Quasi-Likelihood Estimators in Generalized Linear Models with Fixed and Adaptive Designs

Asymptotic Behavior for S-estimators in Random Design Linear Model with Long-Range-dependent Errors

Weak Consistency of Quasi-Maximum Likelihood Estimate in Generalized Linear Models

Asymptotic Properties of Estimation in Generalized Partial Linear Mixed Models

Asymptotic Results for Penalized Quasi-Likelihood Estimation in Generalized Linear Mixed Models

The Quasi-Likelihood for Generalized Linear Models Revisited

Asymptotic Theory of Least Distances Estimate in Multivariate Linear Models

Empirical Likelihood for Generalized Linear Models with Longitudinal Data

Asymptotic theory for QMLE for the real‐time GARCH(1,1) model

An Asymptotic Theory of Sequential Designs based on Maximum Likelihood Recursions

Asymptotic properties of adaptive designs through differentiability in quadratic mean

On the maximum likelihood estimation in general log-linear models

Electron spin resonance investigation of Mn^{2+} ions and their dynamics in manganese doped SrTiO_3

Central Limit Theorems of a Recursive Stochastic Algorithm with Applications to Adaptive Designs

Measure-Transformed Quasi Maximum Likelihood Estimation

Covariate-adjusted response-adaptive designs for generalized linear models

Asymptotics and bootstrap for random-effects panel data transformation models

Asymptotic Behavior of the Maximum Likelihood Estimator for General Markov Switching Models

On the Asymptotic Normality of Estimating the Affine Preferential Attachment Network Models with Random Initial Degrees