Abstract:A classical problem in statistics is estimating the expected coverage of a sample, which has had applications in gene expression, microbial ecology, optimization, and even numismatics. Here we consider a related extension of this problem to random samples of two discrete distributions. Specifically, we estimate what we call the dissimilarity probability of a sample, i.e., the probability of a draw from one distribution not being observed in k draws from another distribution. We show our estimator of dissimilarity to be a U-statistic and a uniformly minimum variance unbiased estimator of dissimilarity over the largest appropriate range of k. Furthermore, despite the non-Markovian nature of our estimator when applied sequentially over k, we show it converges uniformly in probability to the dissimilarity parameter, and we present criteria when it is approximately normally distributed and admits a consistent jackknife estimator of its variance. As proof of concept, we analyze V35 16S rRNA data to discern between various microbial environments. Other potential applications concern any situation where dissimilarity of two discrete distributions may be of interest. For instance, in SELEX experiments, each urn could represent a random RNA pool and each draw a possible solution to a particular binding site problem over that pool. The dissimilarity of these pools is then related to the probability of finding binding site solutions in one pool that are absent in the other.

Estimating several survival functions under uniform stochastic ordering

Maximum Likelihood Estimation of Flexible Survival Densities with Importance Sampling

Ordering properties of the smallest and largest lifetimes in Gompertz-Makeham model

Estimation of Distribution Overlap of Urn Models

Beta Survival Models

Matching Distributions for Survival Data

Exact Semiparametric Inference and Model Selection for Load-Sharing Systems

Non-parametric cure rate estimation under insufficient follow-up using extremes

Stochastic orderings between two finite mixture models with inverted-Kumaraswamy distributed components

Proper Scoring Rules for Survival Analysis

Estimates of Marginal Survival for Dependent Competing Risks Based on an Assumed Copula

Parameter Estimation of Birnbaum-Saunders Distribution under Competing Risks Using the Quantile Variant of the Expectation-Maximization Algorithm

Estimation and Model Selection of Semiparametric Multivariate Survival Functions under General Censorship

Stochastic Orderings between Two Finite Mixtures with Inverted-Kumaraswamy Distributed Components

Estimation for multistate models subject to reporting delays and incomplete event adjudication

Birnbaum–Saunders frailty regression models for clustered survival data

A Note on Stochastic Ordering of Order Statistics

A note on uniform consistency of the product-limit estimator with staggered entry

A Discontinuity Adjustment for Subdistribution Function Confidence Bands Applied to Right-Censored Competing Risks Data (with Erratum)

Nearest Neighbor and Kernel Survival Analysis: Nonasymptotic Error Bounds and Strong Consistency Rates

Stochastic Comparisons on Sample Extremes of Dependent and Heterogenous Observations