Abstract:Stratified random sampling (SRS) is a fundamental sampling technique that provides accurate estimates for aggregate queries using a small size sample, and has been used widely for approximate query processing. A key question in SRS is how to partition a target sample size among different strata. While Neyman allocation provides a solution that minimizes the variance of an estimate using this sample, it works under the assumption that each stratum is abundant, i.e., has a large number of data points to choose from. This assumption may not hold in general: one or more strata may be bounded, and may not contain a large number of data points, even though the total data size may be large. We first present VOILA, an offline method for allocating sample sizes to strata in a variance-optimal manner, even for the case when one or more strata may be bounded. We next consider SRS on streaming data that are continuously arriving. We show a lower bound, that any streaming algorithm for SRS must have (in the worst case) a variance that is {\Omega}(r) factor away from the optimal, where r is the number of strata. We present S-VOILA, a practical streaming algorithm for SRS that is locally variance-optimal in its allocation of sample sizes to different strata. Our result from experiments on real and synthetic data show that VOILA can have significantly (1.4 to 50.0 times) smaller variance than Neyman allocation. The streaming algorithm S-VOILA results in a variance that is typically close to VOILA, which was given the entire input beforehand.

Adaptive Sampling Rule for Ranking-and-Selection Problem

Combined Variance Reduction Techniques in Fully Sequential Selection Procedures

Adaptive Fully Sequential Selection Procedures with Linear and Nonlinear Control Variates

Myopic Allocation Policy with Asymptotically Optimal Sampling Rate.

Asymptotically best response-adaptive randomization procedures☆

Dynamic Sampling Allocation and Design Selection.

Algorithm for Calculating the Initial Sample Size in a Fully Sequential Ranking and Selection Procedure

Efficient Randomized-Adaptive Designs

On the finite-sample statistical validity of adaptive fully sequential procedures

Nonparametric Assessment of Variable Selection and Ranking Algorithms

Efficient Sampling Allocation Procedures for Optimal Quantile Selection

Data-driven Ranking and Selection under Input Uncertainty

Fully Sequential Indifference‐zone Selection Procedures with Variance‐dependent Sampling

Optimal Computing Budget Allocation for Data-driven Ranking and Selection

Variance-Optimal Offline and Streaming Stratified Random Sampling

Unbiased Comparative Evaluation of Ranking Functions

Adaptive Sequential Procedures for Quantile Selection with Importance Sampling

Non-Myopic Knowledge Gradient Policy for Ranking and Selection.

Variable Neighborhood Searching Rerandomization

A low-sample-count, high-precision Pareto front adaptive sampling algorithm based on multi-criteria and Voronoi

Sequential Sampling for Bayesian Robust Ranking and Selection