Abstract:Quantifying and assessing changes in biological diversity are central aspects of many ecological studies, yet accurate methods of estimating biological diversity from sampling data have been elusive. Hill numbers, or the effective number of species, are increasingly used to characterize the taxonomic, phylogenetic, or functional diversity of an assemblage. However, empirical estimates of Hill numbers, including species richness, tend to be an increasing function of sampling effort and, thus, tend to increase with sample completeness. Integrated curves based on sampling theory that smoothly link rarefaction (interpolation) and prediction (extrapolation) standardize samples on the basis of sample size or sample completeness and facilitate the comparison of biodiversity data. Here we extended previous rarefaction and extrapolation models for species richness (Hill number qD, where q = 0) to measures of taxon diversity incorporating relative abundance (i.e., for any Hill number qD, q > 0) and present a unified approach for both individual‐based (abundance) data and sample‐based (incidence) data. Using this unified sampling framework, we derive both theoretical formulas and analytic estimators for seamless rarefaction and extrapolation based on Hill numbers. Detailed examples are provided for the first three Hill numbers: q = 0 (species richness), q = 1 (the exponential of Shannon's entropy index), and q = 2 (the inverse of Simpson's concentration index). We developed a bootstrap method for constructing confidence intervals around Hill numbers, facilitating the comparison of multiple assemblages of both rarefied and extrapolated samples. The proposed estimators are accurate for both rarefaction and short‐range extrapolation. For long‐range extrapolation, the performance of the estimators depends on both the value of q and on the extrapolation range. We tested our methods on simulated data generated from species abundance models and on data from large species inventories. We also illustrate the formulas and estimators using empirical data sets from biodiversity surveys of temperate forest spiders and tropical ants.

Thirty years of progeny from Chao’s inequality: Estimating and comparing richness with incidence data and incomplete sampling

A Comprehensive Review and Evaluation of Species Richness Estimation

An Incidence-Based Richness Estimator for Quadrats Sampled Without Replacement

Species richness estimation with high diversity but spurious singletons

Richness estimation with species identity error

Population size estimation based upon ratios of recapture probabilities

Rarefaction and extrapolation with Hill numbers: a framework for sampling and estimation in species diversity studies

Theory and application of an improved species richness estimator

Estimating regional species richness using a limited number of survey units

Maximum Likelihood Abundance Estimation From Capture-Recapture Data When Covariates Are Missing At Random

Effects of Sample Standardization on Mean Species Detectabilities and Estimates of Relative Differences in Species Richness among Assemblages

Full likelihood inference for abundance from continuous time capture–recapture data

A Nonparametric Approach to the Analysis of Two-Stage Mark-Recapture Experiments

Estimation in Independent Observer Line Transect Surveys for Clustered Populations

Comparing avian species richness estimates from structured and semi-structured citizen science data

Animal abundance estimation in independent observer line transect surveys

Re-estimating National Wealth Inequality with Incorporating the Rich Lists in China

Robust estimation of microbial diversity in theory and in practice

On the estimation of population size—A comparison of capture-recapture and multiplier-benchmark methods

Minimum chi-square method for estimating population size in capture-recapture experiments

Chasing The Tail: A Generalized Pareto Distribution Approach To Estimating Wealth Inequality