Abstract:Estimating the empirical distribution of a scalar-valued data set is a basic and fundamental task. In this paper, we tackle the problem of estimating an empirical distribution in a setting with two challenging features. First, the algorithm does not directly observe the data; instead, it only asks a limited number of threshold queries about each sample. Second, the data are not assumed to be independent and identically distributed; instead, we allow for an arbitrary process generating the samples, including an adaptive adversary. These considerations are relevant, for example, when modeling a seller experimenting with posted prices to estimate the distribution of consumers' willingness to pay for a product: offering a price and observing a consumer's purchase decision is equivalent to asking a single threshold query about their value, and the distribution of consumers' values may be non-stationary over time, as early adopters may differ markedly from late adopters. Our main result quantifies, to within a constant factor, the sample complexity of estimating the empirical CDF of a sequence of elements of $[n]$, up to $\varepsilon$ additive error, using one threshold query per sample. The complexity depends only logarithmically on $n$, and our result can be interpreted as extending the existing logarithmic-complexity results for noisy binary search to the more challenging setting where noise is non-stochastic. Along the way to designing our algorithm, we consider a more general model in which the algorithm is allowed to make a limited number of simultaneous threshold queries on each sample. We solve this problem using Blackwell's Approachability Theorem and the exponential weights method. As a side result of independent interest, we characterize the minimum number of simultaneous threshold queries required by deterministic CDF estimation algorithms.

Thresholds and expectation-thresholds of monotone properties with small minterms

Thresholds and expectation thresholds for larger p

A uniform Dvoretzky-Kiefer-Wolfowitz inequality

On Increments of Sums of Random-Variables Without Moment Hypotheses

Threshold for the expected measure of the convex hull of random points with independent coordinates

Threshold for the expected measure of random polytopes

The Limit Points of the Strong Law of Large Numbers under the Sub-Linear Expectations

Note on a conjecture of Talagrand: expectation thresholds vs. fractional expectation thresholds

Approximations of expectations under infinite product measures

Noisy Computing of the Threshold Function

Baum-Katz type theorems with exact threshold

LIL and the Approximation of Rectangular Sums of B-valued Random Variables when Extreme Terms Are Excluded

Non-Stochastic CDF Estimation Using Threshold Queries

Rosenthal’s Inequalities for Independent and Negatively Dependent Random Variables under Sub-Linear Expectations with Applications

Submodularity, pairwise independence and correlation gap

Exponential inequalities under the sub-linear expectations with applications to laws of the iterated logarithm

A sharp version of Talagrand's selector process conjecture and an application to rounding fractional covers

Some results on fractional vs. expectation thresholds

Phase Transitions for Binomial Sets Under Linear Forms

On monopoly and dynamic monopoly of Cartesian product of graphs with constant thresholds

Maximum likelihood thresholds via graph rigidity