Abstract:Stochastic approximation algorithms have been the subject of an enormous body of literature, both theoretical and applied. Recently, Laruelle and Pag\`es (2013) presented a link between the stochastic approximation and response-adaptive designs in clinical trials based on randomized urn models investigated in Bai and Hu (1999, 2005), and derived the asymptotic normality or central limit theorem for the normalized procedure using a central limit theorem for the stochastic approximation algorithm. However, the classical central limit theorem for the stochastic approximation algorithm does not include all cases of its regression function, creating a gap between the results of Laruelle and Pag\`es (2013) and those of Bai and Hu (2005) for randomized urn models. In this paper, we establish new central limit theorems of the stochastic approximation algorithm under the popular Lindeberg condition to fill this gap. Moreover, we prove that the process of the algorithms can be approximated by a Gaussian process that is a solution of a stochastic differential equation. In our application, we investigate a more involved family of urn models and related adaptive designs in which it is possible to remove the balls from the urn, and the expectation of the total number of balls updated at each stage is not necessary a constant. The asymptotic properties are derived under much less stringent assumptions than those in Bai and Hu (1999, 2005) and Laruelle and Pag\`es (2013).

Limiting behavior of recursive M-estimators in multivariate linear regression models and their asymptotic efficiencies

Limiting Behavior of RecursiveM-Estimators in Multivariate Linear Regression Models

Asymptotic Normality of the Recursive M-estimators of the Scale Parameters

Selecting an Adaptive Sequence for Computing Recursive M-estimators in Multivariate Linear Regression Models

Limiting Behavior of Recursive Algorithm for Estimates of Parameters in Single Index Models

A New Recursive Bounded GM Estimator for Regression

Strong Converge of the Recursive M-estimation when Explanatory Variables Are Design Matrices

Local Linear M-Estimators in Null Recurrent Time Series

Asymptotic expansion for nonparametric M-estimator in a nonlinear regression model with long-memory errors

ROBUST ESTIMATION IN PARAMETRIC TIME SERIES MODELS UNDER LONG‐ AND SHORT‐RANGE‐DEPENDENT STRUCTURES

Improve recursive identification using multi-iteration

Robust Kernel Recursive Adaptive Filtering Algorithms Based on M-estimate

Asymptotic Properties of Nonparametric M-Estimation for Mixing Functional Data

Recursive estimation in large panel data models: Theory and practice

Central Limit Theorems of a Recursive Stochastic Algorithm with Applications to Adaptive Designs

Recursive Least-Squares Method with Membership Functions

Deterministic Inequalities for Smooth M-estimators

Spatial local M-estimation under association

Strong convergence rate of estimators of change point and its application

On the asymptotic behavior of the Nadaraya-Watson estimator associated with the recursive SIR method

The consistency of the estimators in semiparametric regression model based on m-asymptotic negatively associated errors