Multi-color Randomly Reinforced Urn for Adaptive Designs

Li-Xin Zhang,Feifang Hu,Siu Hung Cheung,Wei Sum Chan

2008-01-01

Abstract:This paper is withdrawn

What problem does this paper attempt to address?

Asymptotic Properties of Multicolor Randomly Reinforced Pólya Urns

Li-Xin Zhang,Feifang Hu,Siu Hung Cheung,Wai Sum Chan

DOI: https://doi.org/10.1239/aap/1401369708

2014-01-01

Abstract:The generalized Pólya urn has been extensively studied and is widely applied in many disciplines. An important application of urn models is in the development of randomized treatment allocation schemes in clinical studies. The randomly reinforced urn was recently proposed, but, although the model has some intuitively desirable properties, it lacks theoretical justification. In this paper we obtain important asymptotic properties for multicolor reinforced urn models. We derive results for the rate of convergence of the number of patients assigned to each treatment under a set of minimum required conditions and provide the distributions of the limits. Furthermore, we study the asymptotic behavior for the nonhomogeneous case.
A generalized urn model in clinical trials

Li-Xin Zhang,Wai Sum Chan,Siu Hung Cheung,Feifang Hu

2004-01-01

Abstract:Urn models are very popular and useful for adaptive designs in clinical studies. Among various urn models, the drop-the-loser rule is an efficient adaptive treatment allocation scheme, recently proposed for comparing different treatments in clinical trials. This rule is superior to other randomization schemes in terms of variability and power. In this paper, the drop-the-loser rule is generalized to cope with more popular and practical circumstances including (1) delayed responses when test results cannot be obtained immediately, (2) continuous responses, and (3) a pre-specified target of allocation proportion. In addition, our proposed procedure has several favorable asymptotic properties such as strong consistency and asymptotic normality of the allocation proportion. When the outcomes are dichotomous with identical average allocation proportions as the Wei and Durham (1978), the variabilities of our treatment assignment rule are asymptotic minimum and the rule tends to assign more patients to the better treatment.
A GENERALIZED DROP-THE-LOSER URN FOR CLINICAL TRIALS WITH DELAYED RESPONSES

Li-Xin Zhang,Wai Sum Chan,Siu Hung Cheung,Feifang Hu

IF: 1.4

2007-01-01

Statistica Sinica

Abstract:Urn models are popular and useful for adaptive designs in clinical studies. Among various urn models, the drop-the-loser rule is an efficient adaptive treatment allocation scheme, recently proposed for comparing different treatments in a clinical trial. This rule is superior to other randomization schemes in terms of variability and power. In this paper, the drop-the-loser rule is generalized to cope with more popular and practical circumstances, including (1) delayed responses when test results cannot be obtained immediately, (2) continuous responses, and (3) a prespecified target of allocation proportion. In addition, our proposed procedure has several favorable asymptotic properties such as strong consistency and asymptotic normality of the allocation proportions.
Asymptotic Theorems Of Sequential Estimation-Adjusted Urn Models

Lixin Zhang,Feifang Hu,Siuhung Cheung

DOI: https://doi.org/10.1214/105051605000000746

2006-01-01

Abstract:The Generalized Polya Urn (GPU) is I popular urn model which is widely used in many disciplines. In particular. it is extensively used in treatment allocation schemes in clinical trials. Ill this paper, we propose it sequential estimation-adjusted urn model (a nonhomogeneous GPU) which has a wide spectrum of applications. Because the proposed urn model depends oil sequential estimations of unknown parameters, the derivation of asymptotic properties is mathematically intricate and the corresponding results are unavailable the literature. We overcome these hurdles and establish the strong consistency and asymptotic normality for both the patient allocation and (he estimators of unknown parameters, under some widely Satisfied conditions. These properties are important for statistical inferences and they are also useful for the understanding of the urn limiting process. A superior feature of treatment proportions our proposed model is its capability to yield limiting according to any desired allocation target. The applicability of our model is illustrated with a number of examples.
Asymptotic properties of a multicolored random reinforced urn model with an application to multi-armed bandits

Li Yang,Jiang Hu,Jianghao Li,Zhidong Bai

DOI: https://doi.org/10.48550/arXiv.2406.10854

2024-06-16

Abstract:The random self-reinforcement mechanism, characterized by the principle of ``the rich get richer'', has demonstrated significant utility across various domains. One prominent model embodying this mechanism is the random reinforcement urn model. This paper investigates a multicolored, multiple-drawing variant of the random reinforced urn model. We establish the limiting behavior of the normalized urn composition and demonstrate strong convergence upon scaling the counts of each color. Additionally, we derive strong convergence estimators for the reinforcement means, i.e., for the expectations of the replacement matrix's diagonal elements, and prove their joint asymptotic normality. It is noteworthy that the estimators of the largest reinforcement mean are asymptotically independent of the estimators of the other smaller reinforcement means. Additionally, if a reinforcement mean is not the largest, the estimators of these smaller reinforcement means will also demonstrate asymptotic independence among themselves. Furthermore, we explore the parallels between the reinforced mechanisms in random reinforced urn models and multi-armed bandits, addressing hypothesis testing for expected payoffs in the latter context.

Statistics Theory
Central limit theorem for an adaptive randomly reinforced urn model

Andrea Ghiglietti,Anand N. Vidyashankar,William F. Rosenberger

DOI: https://doi.org/10.1214/16-aap1274

2017-10-01

The Annals of Applied Probability

Abstract:The generalized Pólya urn (GPU) models and their variants have been investigated in several disciplines. However, typical assumptions made with respect to the GPU do not include urn models with a diagonal replacement matrix, which arise in several applications, specifically in clinical trials. To facilitate mathematical analyses of models in these applications, we introduce an adaptive randomly reinforced urn model that uses accruing statistical information to adaptively skew the urn proportion toward specific targets. We study several probabilistic aspects that are important in implementing the urn model in practice. Specifically, we establish the law of large numbers and a central limit theorem for the number of sampled balls. To establish these results, we develop new techniques involving last exit times and crossing time analyses of the proportion of balls in the urn. To obtain precise estimates in these techniques, we establish results on the harmonic moments of the total number of balls in the urn. Finally, we describe our main results in the context of an application to response-adaptive randomization in clinical trials. Our simulation experiments in this context demonstrate the ease and scope of our model.
A Generalized Drop-The-Loser Rule for Multi-Treatment Clinical Trials

Ruibo Sun,Siu Hung Cheung,Li-Xin Zhang

DOI: https://doi.org/10.1016/j.jspi.2006.06.039

IF: 1.095

2007-01-01

Journal of Statistical Planning and Inference

Abstract:Urn models are popular for response adaptive designs in clinical studies. Among different urn models, Ivanova's drop-the-loser rule is capable of producing superior adaptive treatment allocation schemes. Ivanova [2003. A play-the-winner-type urn model with reduced variability. Metrika 58, 1–13] obtained the asymptotic normality only for two treatments. Recently, Zhang et al. [2007. Generalized drop-the-loser urn for clinical trials with delayed responses. Statist. Sinica, in press] extended the drop-the-loser rule to tackle more general circumstances. However, their discussion is also limited to only two treatments. In this paper, the drop-the-loser rule is generalized to multi-treatment clinical trials, and delayed responses are allowed. Moreover, the rule can be used to target any desired pre-specified allocation proportion. Asymptotic properties, including strong consistency and asymptotic normality, are also established for general multi-treatment cases.
The Gaussian Approximation for Generalized Friedman's Urn Model with Heterogeneous and Unbalanced Updating

LiXin Zhang

DOI: https://doi.org/10.1007/s11425-012-4526-4

2012-01-01

Science China Mathematics

Abstract:The Friedman's urn model is a popular urn model which is widely used in many disciplines.In particular,it is extensively used in treatment allocation schemes in clinical trials.Its asymptotic properties have been studied by many researchers.In literature,it is usually assumed that the expected number of balls added at each stage is a constant in despite of what type of balls are selected,that is,the updating of the urn is assumed to be balanced.When it is not,the asymptotic property of the Friedman's urn model is stated in the book of Hu and Rosenberger(2006) as one of open problems in the area of adaptive designs.In this paper,we show that both the urn composition process and the allocation proportion process can be approximated by a multi-dimensional Gaussian process almost surely for a general multi-color Friedman type urn model with heterogeneous and unbalanced updating.The Gaussian process is a solution of a stochastic differential equation.As an application,we obtain the asymptotic properties including the asymptotic normality and the exact law of the iterated logarithm.
The asymptotic theorems of adaptive designs for clinical trials with generations depending on the estimated success rates

Feifang Hu,Li-Xin Zhang

2004-01-01

Abstract:Abstract The randomized play-the winner (RPW) rule is very useful in clinical trials for patient allocation with two treatments. Wei (1979) introduces the generalized Friedman’s urn (GFU) model to clinical trials of K treatment (as an extension of the RPW). In this paper, we consider a general kind of adaptive designs, whose generations depend on an estimated parameter, for example the estimated success rate. Using this kind of adaptive designs, more informations of previous stages are used to update the model at each stage, and more patients may be assigned to a better treatment than the RPW rule and Wei’s rule. The strong consistency and the asymptotic normalities are established for both the urn composition and the number of patients assigned to each treatment. A adaptive design proposed by Bai, Hu and Shen (2001) recently is a simple special example. 1 Introduction and main results 1.1 Introduction and the Model In comparing of K treatments, suppose that patients are available for the study sequentially and must be assigned to a treatment group immediately upon arrival. Adaptive designs, which use accumulating information to assign patients to treatments, tend to assign more patients to better treatments in clinical trials. A typical probability model for adaptive clinical trials is the Generalized Friedman’s Urn (GFU) model (also named as Generalized P´olya Urn (GPU) in literature). The model is described as follows. Consider an urn containing particles of K types, respectively representing K ’treatments’ in a clinical trial. The patients are to be allocated sequentially to the treatments. At the beginning, the urn contains Y0 = (Y0;1;:::;Y0;K) particles, where Y0;k > 0 denotes the number of particles of type k, k = 1;:::;K. At stage i, i = 1;2;:::, a particle is drawn from the urn and replaced. If the particle is of type k, then the treatment k is assigned to the i-th patient, k = 1;:::;K, i = 1;2;:::. After observing a random variables »i;k which may be considered as the response of the i-th patient on the treatment k, an additional Di(k;q;»i;k) particles of type q,
Design and inference for multi-arm clinical trials with informational borrowing: the interacting urns design

Giacomo Aletti,Alessandro Baldi Antognini,Irene Crimaldi,Rosamarie Frieri,Andrea Ghiglietti

2024-07-30

Abstract:This paper deals with a new design methodology for stratified comparative experiments based on interacting reinforced urn systems. The key idea is to model the interaction between urns for borrowing information across strata and to use it in the design phase in order to i) enhance the information exchange at the beginning of the study, when only few subjects have been enrolled and the stratum-specific information on treatments' efficacy could be scarce, ii) let the information sharing adaptively evolves via a reinforcement mechanism based on the observed outcomes, for skewing at each step the allocations towards the stratum-specific most promising treatment and iii) make the contribution of the strata with different treatment efficacy vanishing as the stratum information grows. In particular, we introduce the Interacting Urns Design, namely a new Covariate-Adjusted Response-Adaptive procedure, that randomizes the treatment allocations according to the evolution of the urn system. The theoretical properties of this proposal are described and the corresponding asymptotic inference is provided. Moreover, by a functional central limit theorem, we obtain the asymptotic joint distribution of the Wald-type sequential test statistics, which allows to sequentially monitor the suggested design in the clinical practice.

Methodology,Probability,Statistics Theory
Central Limit Theorems of a Recursive Stochastic Algorithm with Applications to Adaptive Designs

Li-Xin Zhang

DOI: https://doi.org/10.1214/16-aap1187

2016-01-01

The Annals of Applied Probability

Abstract:Stochastic approximation algorithms have been the subject of an enormous body of literature, both theoretical and applied. Recently, Laruelle and Pag\`es (2013) presented a link between the stochastic approximation and response-adaptive designs in clinical trials based on randomized urn models investigated in Bai and Hu (1999, 2005), and derived the asymptotic normality or central limit theorem for the normalized procedure using a central limit theorem for the stochastic approximation algorithm. However, the classical central limit theorem for the stochastic approximation algorithm does not include all cases of its regression function, creating a gap between the results of Laruelle and Pag\`es (2013) and those of Bai and Hu (2005) for randomized urn models. In this paper, we establish new central limit theorems of the stochastic approximation algorithm under the popular Lindeberg condition to fill this gap. Moreover, we prove that the process of the algorithms can be approximated by a Gaussian process that is a solution of a stochastic differential equation. In our application, we investigate a more involved family of urn models and related adaptive designs in which it is possible to remove the balls from the urn, and the expectation of the total number of balls updated at each stage is not necessary a constant. The asymptotic properties are derived under much less stringent assumptions than those in Bai and Hu (1999, 2005) and Laruelle and Pag\`es (2013).
Asymptotic Results on a Class of Adaptive Multi-Treatment Designs

Z Li-Xin

DOI: https://doi.org/10.1016/j.jmva.2005.06.002

IF: 1.387

2005-01-01

Journal of Multivariate Analysis

Abstract:The play-the-winner (PW) rule is an important method in clinical trials where patients can be assigned to one of the two treatments. In the PW rule, the probability of the next patient to be assigned to a particular treatment only depends on the response of the current patient. In this paper, we consider a general kind of PW rule for multi-treatment adaptive designs, in which the probability that a treatment is assigned to the next patient depends upon both the response of the previous patient and an estimated parameter, e.g., the observed success rate. Using this kind of adaptive designs, more information of previous stages are used to update the model at each stage, and more patients may be assigned to better treatments. The strong consistency and the asymptotic normality are established for the allocation proportions.
Adaptive Designs for Sequential Experiments

Lin Zheng-yan,Zhang Li-xin

DOI: https://doi.org/10.1631/jzus.2003.0214

2003-01-01

Journal of Zhejiang University SCIENCE A

Abstract:Various adaptive designs have been proposed and applied to clinical trials, bioassay, psychophysics, etc. Adaptive designs are also useful in high cost engineering trials. More and more people have been paying attention to these design methods. This paper introduces several broad families of designs, such asthe play-the-winner rule, randomized play-the-winner rule and its generalization to the multi-arm case, doubly biased coin adaptive design, Markov chain model.
Doubly Adaptive Biased Coin Designs with Delayed Responses

Feifang Hu,Li-Xin Zhang,Siu H. Cheung,Wai S. Chan

DOI: https://doi.org/10.1002/cjs.5550360404

2008-01-01

Canadian Journal of Statistics

Abstract:In clinical studies, patients are usually accrued sequentially. Response‐adaptive designs are then useful tools for assigning treatments to incoming patients as a function of the treatment responses observed thus far. In this regard, doubly adaptive biased coin designs have advantageous properties under the assumption that their responses can be obtained immediately after testing. However, it is a common occurrence that responses are observed only after a certain period of time. The authors examine the effect of delayed responses on doubly adaptive biased coin designs and derive some of their asymptotic properties. It turns out that these designs are relatively insensitive to delayed responses under widely satisfied conditions. This is illustrated with a simulation study.
Asymptotic normality of urn models for clinical trials with delayed response

Feifang Hu,Lixin Zhang

DOI: https://doi.org/10.3150/bj/1089206406

IF: 1.5

2004-01-01

Bernoulli

Abstract:For response-adaptive clinical trials using a generalized Friedman's urn design, we derive the asymptotic normality of the sample fraction assigned to each treatment under staggered entry and delayed response. The rate of convergence and the law of the iterated logarithm are obtained for both the urn composition and the sample fraction. Some applications are also discussed.
Efficient Randomized-Adaptive Designs

Feifang Hu,Li-Xin Zhang,Xuming He

DOI: https://doi.org/10.1214/08-aos655

2009-01-01

Abstract:Response-adaptive randomization hits recently attracted a lot of attention in the literature. In this paper, we propose a new and simple family of response-adaptive randomization procedures that attain the cramer-Rao lower bounds on the allocation variances for any allocation proportions including optimal allocation proportions. The allocation Probability functions of proposed procedures are discontinuous. The existing large sample theory for adaptive designs relies on Taylor expansions of the allocation probability functions. which do not apply to nondifferentiable cases. In the present paper, we Study stopping times of stochastic processes to establish the asymptotic efficiency results. Furthermore, we demonstrate our proposal through examples, simulations and a discussion on the relationship with earlier works, including Efron's biased coin design.
The Rescaled Polya Urn: local reinforcement and chi-squared goodness of fit test

Giacomo Aletti,Irene Crimaldi

DOI: https://doi.org/10.1017/apr.2021.56

2020-07-15

Abstract:Motivated by recent studies of big samples, this work aims at constructing a parametric model which is characterized by the following features: (i) a "local" reinforcement, i.e. a reinforcement mechanism mainly based on the last observations, (ii) a random persistent fluctuation of the predictive mean, and (iii) a long-term convergence of the empirical mean to a deterministic limit, together with a chi-squared goodness of fit result. This triple purpose has been achieved by the introduction of a new variant of the Eggenberger-Polya urn, that we call the "Rescaled" Polya urn. We provide a complete asymptotic characterization of this model, pointing out that, for a certain choice of the parameters, it has properties different from the ones typically exhibited from the other urn models in the literature. Therefore, beyond the possible statistical application, this work could be interesting for those who are concerned with stochastic processes with reinforcement.

Statistics Theory,Probability,Methodology
Asymptotic properties of doubly adaptive biased coin designs for multitreatment clinical trials

FEIFANG HU,LI-XIN ZHANG

DOI: https://doi.org/10.1214/aos/1079120137

2004-01-01

Abstract:A general doubly adaptive biased coin design is proposed for the allocation of subjects to K treatments in a clinical trial. This design follows the same spirit as Efron's biased coin design and applies to the cases where the desired allocation proportions are unknown, but estimated sequentially. Strong consistency, a law of the iterated logarithm and asymptotic normality of this design are obtained under some widely satisfied conditions. For two treatments, a new family of designs is proposed and shown to be less variable than both the randomized play-the-winner rule and the adaptive randomized design. Also the proposed design tends toward a randomization scheme (with a fixed target proportion) as the size of the experiment increases.
Adaptive Allocation Theory in Clinical Trials

Li-Xin Zhang

DOI: https://doi.org/10.48550/arXiv.math/0612811

2006-12-28

Abstract:Various adaptive randomization procedures (adaptive designs) have been proposed to clinical trials. This paper discusses several broad families of procedures, such as the play-the-winner rule and Markov chain model, randomized play-the-winner rule and urn models, drop-the-loser rule, doubly biased coin adaptive design. Asymptotic theories are presented with several pivotal proofs. The effect of delayed responses, the power and variability comparison of these designs are also discussed.

Statistics Theory,Probability,Methodology
Urn models with two types of strategies

Manuel González-Navarrete,Rodrigo Lambert

DOI: https://doi.org/10.48550/arXiv.1708.06430

2019-03-13

Abstract:We study an urn process containing red and blue balls and two different strategies to reinforce the urn. Namely, a generalized Pólya-type strategy versus an i.i.d. one. At each step, one of the two reinforcement strategies is chosen by flipping a coin. We study the asymptotic behaviour of this urn model, and prove a law of large numbers, a central limit theorem and a functional limit theorem for the proportion of balls into the urn. A phase transition is also stated.

Probability

Multi-color Randomly Reinforced Urn for Adaptive Designs

Asymptotic Properties of Multicolor Randomly Reinforced Pólya Urns

A generalized urn model in clinical trials

A GENERALIZED DROP-THE-LOSER URN FOR CLINICAL TRIALS WITH DELAYED RESPONSES

Asymptotic Theorems Of Sequential Estimation-Adjusted Urn Models

Asymptotic properties of a multicolored random reinforced urn model with an application to multi-armed bandits

Central limit theorem for an adaptive randomly reinforced urn model

A Generalized Drop-The-Loser Rule for Multi-Treatment Clinical Trials

The Gaussian Approximation for Generalized Friedman's Urn Model with Heterogeneous and Unbalanced Updating

The asymptotic theorems of adaptive designs for clinical trials with generations depending on the estimated success rates

Design and inference for multi-arm clinical trials with informational borrowing: the interacting urns design

Central Limit Theorems of a Recursive Stochastic Algorithm with Applications to Adaptive Designs

Asymptotic Results on a Class of Adaptive Multi-Treatment Designs

Adaptive Designs for Sequential Experiments

Doubly Adaptive Biased Coin Designs with Delayed Responses

Asymptotic normality of urn models for clinical trials with delayed response

Efficient Randomized-Adaptive Designs

The Rescaled Polya Urn: local reinforcement and chi-squared goodness of fit test

Asymptotic properties of doubly adaptive biased coin designs for multitreatment clinical trials

Adaptive Allocation Theory in Clinical Trials

Urn models with two types of strategies