Abstract:The availability of high-throughput parallel methods for sequencing microbial communities is increasing our knowledge of the microbial world at an unprecedented rate. Though most attention has focused on determining lower-bounds on the alpha-diversity i.e. the total number of different species present in the environment, tight bounds on this quantity may be highly uncertain because a small fraction of the environment could be composed of a vast number of different species. To better assess what remains unknown, we propose instead to predict the fraction of the environment that belongs to unsampled classes. Modeling samples as draws with replacement of colored balls from an urn with an unknown composition, and under the sole assumption that there are still undiscovered species, we show that conditionally unbiased predictors and exact prediction intervals (of constant length in logarithmic scale) are possible for the fraction of the environment that belongs to unsampled classes. Our predictions are based on a Poissonization argument, which we have implemented in what we call the Embedding algorithm. In fixed i.e. non-randomized sample sizes, the algorithm leads to very accurate predictions on a sub-sample of the original sample. We quantify the effect of fixed sample sizes on our prediction intervals and test our methods and others found in the literature against simulated environments, which we devise taking into account datasets from a human-gut and -hand microbiota. Our methodology applies to any dataset that can be conceptualized as a sample with replacement from an urn. In particular, it could be applied, for example, to quantify the proportion of all the unseen solutions to a binding site problem in a random RNA pool, or to reassess the surveillance of a certain terrorist group, predicting the conditional probability that it deploys a new tactic in a next attack.

Immigrated urn models - asymptotic properties and applications

Immigrated Urn Models—theoretical Properties and Applications

Asymptotic Theorems Of Sequential Estimation-Adjusted Urn Models

A generalized urn model in clinical trials

Asymptotic Properties of Multicolor Randomly Reinforced Pólya Urns

The Gaussian Approximation for Generalized Friedman's Urn Model with Heterogeneous and Unbalanced Updating

Asymptotic normality of urn models for clinical trials with delayed response

The Gaussian approximation for multi-color generalized Friedman’s urn model

Convergence of randomized urn models with irreducible and reducible replacement policy

A GENERALIZED DROP-THE-LOSER URN FOR CLINICAL TRIALS WITH DELAYED RESPONSES

Gaussian Approximation Theorems for Urn Models and Their Applications

Design and inference for multi-arm clinical trials with informational borrowing: the interacting urns design

A Gaussian Process Approximation for Two-Color Randomly Reinforced Urns

Central limit theorem for an adaptive randomly reinforced urn model

A Generalized Drop-The-Loser Rule for Multi-Treatment Clinical Trials

Central Limit Theorems of a Recursive Stochastic Algorithm with Applications to Adaptive Designs

The Rescaled Polya Urn: local reinforcement and chi-squared goodness of fit test

Extrapolation of Urn Models via Poissonization: Accurate Measurements of the Microbial Unknown

Estimation of Distribution Overlap of Urn Models

On Generalized Pólya Urn Models

Analysis of Large Urn Models with Local Mean-Field Interactions