Abstract:Estimating the empirical distribution of a scalar-valued data set is a basic and fundamental task. In this paper, we tackle the problem of estimating an empirical distribution in a setting with two challenging features. First, the algorithm does not directly observe the data; instead, it only asks a limited number of threshold queries about each sample. Second, the data are not assumed to be independent and identically distributed; instead, we allow for an arbitrary process generating the samples, including an adaptive adversary. These considerations are relevant, for example, when modeling a seller experimenting with posted prices to estimate the distribution of consumers' willingness to pay for a product: offering a price and observing a consumer's purchase decision is equivalent to asking a single threshold query about their value, and the distribution of consumers' values may be non-stationary over time, as early adopters may differ markedly from late adopters. Our main result quantifies, to within a constant factor, the sample complexity of estimating the empirical CDF of a sequence of elements of $[n]$, up to $\varepsilon$ additive error, using one threshold query per sample. The complexity depends only logarithmically on $n$, and our result can be interpreted as extending the existing logarithmic-complexity results for noisy binary search to the more challenging setting where noise is non-stochastic. Along the way to designing our algorithm, we consider a more general model in which the algorithm is allowed to make a limited number of simultaneous threshold queries on each sample. We solve this problem using Blackwell's Approachability Theorem and the exponential weights method. As a side result of independent interest, we characterize the minimum number of simultaneous threshold queries required by deterministic CDF estimation algorithms.

On the Sample Complexity of Compressed Counting

A Very Efficient Scheme for Estimating Entropy of Data Streams Using Compressed Counting

Random Sampling Using Shannon Interpolation and Poisson Summation Formulae

The Optimal Quantile Estimator for Compressed Counting

Debiased Distribution Compression

Non-Stochastic CDF Estimation Using Threshold Queries

Compressive Sampling of Polynomial Chaos Expansions: Convergence Analysis and Sampling Strategies

On the Sample Complexity of Multichannel Frequency Estimation Via Convex Optimization.

Sample Complexity Bounds for 1-bit Compressive Sensing and Binary Stable Embeddings with Generative Priors

Simple Analysis of Priority Sampling

The Sample Complexity of Simple Binary Hypothesis Testing

Adaptive complexity of log-concave sampling

Profile Entropy: A Fundamental Measure for the Learnability and Compressibility of Discrete Distributions

Count-Min Sketch with Conservative Updates: Worst-Case Analysis

Statistical-Computational Trade-offs for Density Estimation

On the computation of Shannon Entropy from Counting Bloom Filters

Tight Space Lower Bound for Pseudo-Deterministic Approximate Counting

Average Case Analysis of Compressive Multichannel Frequency Estimation Using Atomic Norm Minimization

Fine-grained Probability Counting for Cardinality Estimation of Data Streams.

One-Shot Min-Entropy Calculation And Its Application To Quantum Cryptography

On the Statistical Complexity of Sample Amplification