Abstract:Estimating the empirical distribution of a scalar-valued data set is a basic and fundamental task. In this paper, we tackle the problem of estimating an empirical distribution in a setting with two challenging features. First, the algorithm does not directly observe the data; instead, it only asks a limited number of threshold queries about each sample. Second, the data are not assumed to be independent and identically distributed; instead, we allow for an arbitrary process generating the samples, including an adaptive adversary. These considerations are relevant, for example, when modeling a seller experimenting with posted prices to estimate the distribution of consumers' willingness to pay for a product: offering a price and observing a consumer's purchase decision is equivalent to asking a single threshold query about their value, and the distribution of consumers' values may be non-stationary over time, as early adopters may differ markedly from late adopters. Our main result quantifies, to within a constant factor, the sample complexity of estimating the empirical CDF of a sequence of elements of $[n]$, up to $\varepsilon$ additive error, using one threshold query per sample. The complexity depends only logarithmically on $n$, and our result can be interpreted as extending the existing logarithmic-complexity results for noisy binary search to the more challenging setting where noise is non-stochastic. Along the way to designing our algorithm, we consider a more general model in which the algorithm is allowed to make a limited number of simultaneous threshold queries on each sample. We solve this problem using Blackwell's Approachability Theorem and the exponential weights method. As a side result of independent interest, we characterize the minimum number of simultaneous threshold queries required by deterministic CDF estimation algorithms.

Hitting times of threshold exceedances and their distributions

Clustering and Hitting Times of Threshold Exceedances and Applications

Extremes Control of Complex Systems With Applications to Social Network

A local statistic for the spatial extent of extreme threshold exceedances

Non-Stochastic CDF Estimation Using Threshold Queries

On the spatial extent of extreme threshold exceedances

How clustering affects the bond percolation threshold in complex networks

Hidden tail chains and recurrence equations for dependence parameters associated with extremes of stationary higher-order Markov chains

Distribution and dependence of extremes in network sampling processes

Modelling the clustering of extreme events for short-term risk assessment

On exceedance times for some processes with dependent increments

Dynamics of the threshold model on hypergraphs

Threshold and Hitting Time for High-Order Connectedness in Random Hypergraphs

A remarkable example on clustering of extremes for regularly-varying stochastic processes

Threshold for the Outbreak of Cascading Failures in Degree-degree Uncorrelated Networks

Threshold and hitting time for high-order connectivity in random hypergraphs

The hitting time of nice factors

Threshold driven contagion on weighted networks

Fluctuations of the connectivity threshold and largest nearest-neighbour link

Convergence of Marked Point Processes of Excesses for Dynamical Systems

Time Sensitive Analysis of Independent and Stationary Increment Processes