Abstract:Estimating the empirical distribution of a scalar-valued data set is a basic and fundamental task. In this paper, we tackle the problem of estimating an empirical distribution in a setting with two challenging features. First, the algorithm does not directly observe the data; instead, it only asks a limited number of threshold queries about each sample. Second, the data are not assumed to be independent and identically distributed; instead, we allow for an arbitrary process generating the samples, including an adaptive adversary. These considerations are relevant, for example, when modeling a seller experimenting with posted prices to estimate the distribution of consumers' willingness to pay for a product: offering a price and observing a consumer's purchase decision is equivalent to asking a single threshold query about their value, and the distribution of consumers' values may be non-stationary over time, as early adopters may differ markedly from late adopters. Our main result quantifies, to within a constant factor, the sample complexity of estimating the empirical CDF of a sequence of elements of $[n]$, up to $\varepsilon$ additive error, using one threshold query per sample. The complexity depends only logarithmically on $n$, and our result can be interpreted as extending the existing logarithmic-complexity results for noisy binary search to the more challenging setting where noise is non-stochastic. Along the way to designing our algorithm, we consider a more general model in which the algorithm is allowed to make a limited number of simultaneous threshold queries on each sample. We solve this problem using Blackwell's Approachability Theorem and the exponential weights method. As a side result of independent interest, we characterize the minimum number of simultaneous threshold queries required by deterministic CDF estimation algorithms.

Estimation of a convex discrete distribution

Generating Probability Distributions on Intervals and Spheres: Convex Decomposition

Statistical inference of convex order by Wasserstein projection

On Semi-supervised Estimation of Discrete Distributions under f-divergences

Non-Stochastic CDF Estimation Using Threshold Queries

Convex Regression in Multidimensions: Suboptimality of Least Squares Estimators

Distribution Estimation under the Infinity Norm

Optimal unbiased estimators via convex hulls

Non-concave distributionally robust stochastic control in a discrete time finite horizon setting

More on discrete convexity

Convex Discrete Optimization

Characterizing the minimax rate of nonparametric regression under bounded convex constraints

Estimating a probability of failure with the convex order in computer experiments

The Bernoulli structure of discrete distributions

On a Conjecture of Feige for Discrete Log-Concave Distributions

Least Squares Estimation of a Quasiconvex Regression Function

Semi-Discrete Optimal Transport: Nearly Minimax Estimation With Stochastic Gradient Descent and Adaptive Entropic Regularization

Convex ordering of solutions to one-dimensional SDEs

Dualizing Le Cam's method for functional estimation, with applications to estimating the unseens

Set Estimation from Projected Multidimensional Random Variables with Application to a Discrete-Time Skorokhod Problem

Distributional regression: CRPS-error bounds for model fitting, model selection and convex aggregation