Abstract:We study the fundamental problem of sampling independent events, called subset sampling. Specifically, consider a set of $n$ events $S=\{x_1, \ldots, x_n\}$, where each event $x_i$ has an associated probability $p(x_i)$. The subset sampling problem aims to sample a subset $T \subseteq S$, such that every $x_i$ is independently included in $S$ with probability $p_i$. A naive solution is to flip a coin for each event, which takes $O(n)$ time. However, the specific goal is to develop data structures that allow drawing a sample in time proportional to the expected output size $\mu=\sum_{i=1}^n p(x_i)$, which can be significantly smaller than $n$ in many applications. The subset sampling problem serves as an important building block in many tasks and has been the subject of various research for more than a decade. However, most of the existing subset sampling approaches are conducted in a static setting, where the events or their associated probability in set $S$ is not allowed to be changed over time. These algorithms incur either large query time or update time in a dynamic setting despite the ubiquitous time-evolving events with changing probability in real life. Therefore, it is a pressing need, but still, an open problem, to design efficient dynamic subset sampling algorithms. In this paper, we propose ODSS, the first optimal dynamic subset sampling algorithm. The expected query time and update time of ODSS are both optimal, matching the lower bounds of the subset sampling problem. We present a nontrivial theoretical analysis to demonstrate the superiority of ODSS. We also conduct comprehensive experiments to empirically evaluate the performance of ODSS. Moreover, we apply ODSS to a concrete application: influence maximization. We empirically show that our ODSS can improve the complexities of existing influence maximization algorithms on large real-world evolving social networks.

An Optimal External Selection Algorithm and Its Application in the Internet.

Gois: Optimal Item Selection With Generalized Cross-Selling Considerations

Distributed Privacy-Aware Fast Selection Algorithm for Large-Scale Data.

Sample-Optimal Large-Scale Optimal Subset Selection

Dualheap Selection Algorithm: Efficient, Inherently Parallel and Somewhat Mysterious

Optimal Data Selection: An Online Distributed View

A REVIEW OF STATIC AND DYNAMIC OPTIMIZATION FOR RANKING AND SELECTION

Parallel External Selection Algorithm on Distributed Memory Systems

Myopic Allocation Policy with Asymptotically Optimal Sampling Rate.

Dynamic Sampling Allocation and Design Selection.

Joint Source Selection And Transfer Optimization For Erasure Coding Storage System

Optimal Dynamic Subset Sampling: Theory and Applications

Search-Efficient Computerized Adaptive Testing

An Optimal Sample Allocation Strategy for Partition-Based Random Search.

Novel item selection strategies for cognitive diagnostic computerized adaptive testing: A heuristic search framework

A Budget-Adaptive Allocation Rule for Optimal Computing Budget Allocation

THRESHOLD RULES FOR ONLINE SAMPLE SELECTION

An Indifference-Zone Selection Procedure with Minimum Switching and Sequential Sampling

Optimal Computing Budget Allocation for Data-driven Ranking and Selection

An efficient algorithm for data transmission certainty in IIoT sensing network: A priority-based approach

Over-Selection: an Attempt to Boost EDA under Small Population Size.