Abstract:Stochastic approximation algorithms have been the subject of an enormous body of literature, both theoretical and applied. Recently, Laruelle and Pag\`es (2013) presented a link between the stochastic approximation and response-adaptive designs in clinical trials based on randomized urn models investigated in Bai and Hu (1999, 2005), and derived the asymptotic normality or central limit theorem for the normalized procedure using a central limit theorem for the stochastic approximation algorithm. However, the classical central limit theorem for the stochastic approximation algorithm does not include all cases of its regression function, creating a gap between the results of Laruelle and Pag\`es (2013) and those of Bai and Hu (2005) for randomized urn models. In this paper, we establish new central limit theorems of the stochastic approximation algorithm under the popular Lindeberg condition to fill this gap. Moreover, we prove that the process of the algorithms can be approximated by a Gaussian process that is a solution of a stochastic differential equation. In our application, we investigate a more involved family of urn models and related adaptive designs in which it is possible to remove the balls from the urn, and the expectation of the total number of balls updated at each stage is not necessary a constant. The asymptotic properties are derived under much less stringent assumptions than those in Bai and Hu (1999, 2005) and Laruelle and Pag\`es (2013).

Asymptotic Normality of a Class of Adaptive Statistics with Applications to Synthetic Data Methods for Censored Regression

ASYMPTOTIC NORMALITY OF KERNEL ESTIMATES OF A DENSITY FUNCTION UNDER ASSOCIATION DEPENDENCE

Asymptotic Normality for U-statistics of Negatively Associated Random Variables

Asymptotic Distributions of Innovation Density Estimators in Linear Processes

Asymptotic Normality of Conditional Density Estimation under Truncated, Censored and Dependent Data

Central Limit Theorems of a Recursive Stochastic Algorithm with Applications to Adaptive Designs

The Asymptotic Normality of Estimation on Semivarying Coefficient Models with Censored Data

Estimation and Asymptotic Normality for Partially Linear Models with Censored Data

Asymptotic Normality for Regression Function Estimate under Truncation and Α-Mixing Conditions

Asymptotic Normality of Error Distribution Estimator in Autoregressive Models

Asymptotics for A Class of Dependent Random Variables

Copula-based Semiparametric Nonnormal Transformed Linear Model for Survival Data with Dependent Censoring

Asymptotic Normality of a Wavelet Estimator for Asymptotically Negatively Associated Errors

Estimation of Unknown Parameters of Truncated Normal Distribution under Adaptive Progressive Type II Censoring Scheme

Asymptotic Normality and Confidence Intervals for Prediction Risk of the Min-Norm Least Squares Estimator.

ON SELF‐NORMALIZATION FOR CENSORED DEPENDENT DATA

Asymptotic Normality of Extreme Value Estimators on C[0,1]

A Large Sample Study of Rank Estimation for Censored Regression Data

Empirical Likelihood Based Synthetic Data Method for Censored Regression Analysis

Asymptotic normality and Berry–Esseen results for conditional density estimator with censored and dependent data

Adaptive Linear Estimating Equations