Abstract:Stochastic approximation algorithms have been the subject of an enormous body of literature, both theoretical and applied. Recently, Laruelle and Pag\`es (2013) presented a link between the stochastic approximation and response-adaptive designs in clinical trials based on randomized urn models investigated in Bai and Hu (1999, 2005), and derived the asymptotic normality or central limit theorem for the normalized procedure using a central limit theorem for the stochastic approximation algorithm. However, the classical central limit theorem for the stochastic approximation algorithm does not include all cases of its regression function, creating a gap between the results of Laruelle and Pag\`es (2013) and those of Bai and Hu (2005) for randomized urn models. In this paper, we establish new central limit theorems of the stochastic approximation algorithm under the popular Lindeberg condition to fill this gap. Moreover, we prove that the process of the algorithms can be approximated by a Gaussian process that is a solution of a stochastic differential equation. In our application, we investigate a more involved family of urn models and related adaptive designs in which it is possible to remove the balls from the urn, and the expectation of the total number of balls updated at each stage is not necessary a constant. The asymptotic properties are derived under much less stringent assumptions than those in Bai and Hu (1999, 2005) and Laruelle and Pag\`es (2013).

Asymptotic Behavior for S-estimators in Random Design Linear Model with Long-Range-dependent Errors

ROBUST ESTIMATION IN PARAMETRIC TIME SERIES MODELS UNDER LONG‐ AND SHORT‐RANGE‐DEPENDENT STRUCTURES

Asymptotic expansion for nonparametric M-estimator in a nonlinear regression model with long-memory errors

The Quadratic Inference Functions in Measurement Error Model for Longitudinal Data

Asymptotic Distributions of Innovation Density Estimators in Linear Processes

Local Linear M‐estimation in Non‐parametric Spatial Regression

Precise Asymptotics in the Law of the Iterated Logarithm for R/S Statistic

Local linear M-estimation for spatial processes in fixed-design models

Central Limit Theorems of a Recursive Stochastic Algorithm with Applications to Adaptive Designs

Asymptotic Theory of Least Distances Estimate in Multivariate Linear Models

The rates of strong consistency for estimators in heteroscedastic partially linear errors-in-variables model for widely orthant dependent samples

Asymptotic Efficient Estimation in Semiparametric Nonlinear Regression Models

Strong Consistency of Maximum Quasi-Likelihood Estimators in Generalized Linear Models with Fixed and Adaptive Designs

Asymptotics of Estimates in Constrained Nonlinear Regression with Long-Range Dependent Innovations

Inference for High‐dimensional Linear Models with Locally Stationary Error Processes

Generalized varying coefficient partially linear measurement errors models

Local Asymptotic Behavior of Regression Splines for Marginal Semiparametric Models with Longitudinal Data

On the Asymptotics of Marginal Regression Splines with Longitudinal Data

Optimal designs for linear regression models with skew-normal errors

Optimal designs for linear models with Fredholm-type errors

Adjusted Design Effect Model for Longitudinal Survey Data