Abstract:Estimating the empirical distribution of a scalar-valued data set is a basic and fundamental task. In this paper, we tackle the problem of estimating an empirical distribution in a setting with two challenging features. First, the algorithm does not directly observe the data; instead, it only asks a limited number of threshold queries about each sample. Second, the data are not assumed to be independent and identically distributed; instead, we allow for an arbitrary process generating the samples, including an adaptive adversary. These considerations are relevant, for example, when modeling a seller experimenting with posted prices to estimate the distribution of consumers' willingness to pay for a product: offering a price and observing a consumer's purchase decision is equivalent to asking a single threshold query about their value, and the distribution of consumers' values may be non-stationary over time, as early adopters may differ markedly from late adopters. Our main result quantifies, to within a constant factor, the sample complexity of estimating the empirical CDF of a sequence of elements of $[n]$, up to $\varepsilon$ additive error, using one threshold query per sample. The complexity depends only logarithmically on $n$, and our result can be interpreted as extending the existing logarithmic-complexity results for noisy binary search to the more challenging setting where noise is non-stochastic. Along the way to designing our algorithm, we consider a more general model in which the algorithm is allowed to make a limited number of simultaneous threshold queries on each sample. We solve this problem using Blackwell's Approachability Theorem and the exponential weights method. As a side result of independent interest, we characterize the minimum number of simultaneous threshold queries required by deterministic CDF estimation algorithms.

Clustering and Hitting Times of Threshold Exceedances and Applications

Hitting times of threshold exceedances and their distributions

Extremes Control of Complex Systems With Applications to Social Network

How clustering affects the bond percolation threshold in complex networks

Non-Stochastic CDF Estimation Using Threshold Queries

Modelling the clustering of extreme events for short-term risk assessment

A remarkable example on clustering of extremes for regularly-varying stochastic processes

Dynamics of the threshold model on hypergraphs

Clustering of extreme values: estimation and application

On The Clustering Coefficients Of Temporal Networks And Epidemic Dynamics

Efficient Computation of Mean Truncated Hitting Times on Very Large Graphs

Asymptotic analysis of threshold models for social networks

Distribution and dependence of extremes in network sampling processes

Threshold for the Outbreak of Cascading Failures in Degree-degree Uncorrelated Networks

Threshold driven contagion on weighted networks

The hitting time of nice factors

Fluctuations of the connectivity threshold and largest nearest-neighbour link

Cluster Scaling and Critical Points: A Cautionary Tale

Threshold and Hitting Time for High-Order Connectedness in Random Hypergraphs

Clustering-based Identification of Precursors of Extreme Events in Chaotic Systems

Hidden tail chains and recurrence equations for dependence parameters associated with extremes of stationary higher-order Markov chains