Abstract:Estimating the empirical distribution of a scalar-valued data set is a basic and fundamental task. In this paper, we tackle the problem of estimating an empirical distribution in a setting with two challenging features. First, the algorithm does not directly observe the data; instead, it only asks a limited number of threshold queries about each sample. Second, the data are not assumed to be independent and identically distributed; instead, we allow for an arbitrary process generating the samples, including an adaptive adversary. These considerations are relevant, for example, when modeling a seller experimenting with posted prices to estimate the distribution of consumers' willingness to pay for a product: offering a price and observing a consumer's purchase decision is equivalent to asking a single threshold query about their value, and the distribution of consumers' values may be non-stationary over time, as early adopters may differ markedly from late adopters. Our main result quantifies, to within a constant factor, the sample complexity of estimating the empirical CDF of a sequence of elements of $[n]$, up to $\varepsilon$ additive error, using one threshold query per sample. The complexity depends only logarithmically on $n$, and our result can be interpreted as extending the existing logarithmic-complexity results for noisy binary search to the more challenging setting where noise is non-stochastic. Along the way to designing our algorithm, we consider a more general model in which the algorithm is allowed to make a limited number of simultaneous threshold queries on each sample. We solve this problem using Blackwell's Approachability Theorem and the exponential weights method. As a side result of independent interest, we characterize the minimum number of simultaneous threshold queries required by deterministic CDF estimation algorithms.

Answering unique topic queries with dynamic threshold

Non-Stochastic CDF Estimation Using Threshold Queries

Efficiently answering top-k frequent term queries in temporal-categorical range

Efficiently Answering Probabilistic Threshold Top-k Queries on Uncertain Data

Dual Dynamic Threshold Adjustment Strategy

Dual Dynamic Threshold Adjustment Strategy for Deep Metric Learning

Processing Long Queries Against Short Text

Towards Efficient Re-mining of Frequent Patterns Upon Threshold Changes

Efficient Algorithm for a Novel Pattern of Time Series

Probabilistic Threshold Range Aggregate Query Processing over Uncertain Data

Energy Efficient Top-K Query Processing In Dynamic Sensor Network

Research on Text Hierarchical Topic Identification Algorithm Based on the Dynamic Diverse Thresholds Clustering

Utilizing Related Samples to Learn Complex Queries in Interactive Concept-Based Video Search

Using Temporal Information in Topic Detection

ADT: Agent-based Dynamic Thresholding for Anomaly Detection

Diversified Spatial Keyword Query on Topic Coverage

Efficient Top-K Query Algorithms Using Density Index

Threshold-based probabilistic top- k dominating queries

Ranking Queries on Uncertain Data

Sliding-Window Probabilistic Threshold Aggregate Queries on Uncertain Data Streams

Mining At Most Top-K% Mixed-Drove Spatio-Temporal Co-Occurrence Patterns