Abstract:We study the fundamental problem of sampling independent events, called subset sampling. Specifically, consider a set of $n$ events $S=\{x_1, \ldots, x_n\}$, where each event $x_i$ has an associated probability $p(x_i)$. The subset sampling problem aims to sample a subset $T \subseteq S$, such that every $x_i$ is independently included in $S$ with probability $p_i$. A naive solution is to flip a coin for each event, which takes $O(n)$ time. However, the specific goal is to develop data structures that allow drawing a sample in time proportional to the expected output size $\mu=\sum_{i=1}^n p(x_i)$, which can be significantly smaller than $n$ in many applications. The subset sampling problem serves as an important building block in many tasks and has been the subject of various research for more than a decade. However, most of the existing subset sampling approaches are conducted in a static setting, where the events or their associated probability in set $S$ is not allowed to be changed over time. These algorithms incur either large query time or update time in a dynamic setting despite the ubiquitous time-evolving events with changing probability in real life. Therefore, it is a pressing need, but still, an open problem, to design efficient dynamic subset sampling algorithms. In this paper, we propose ODSS, the first optimal dynamic subset sampling algorithm. The expected query time and update time of ODSS are both optimal, matching the lower bounds of the subset sampling problem. We present a nontrivial theoretical analysis to demonstrate the superiority of ODSS. We also conduct comprehensive experiments to empirically evaluate the performance of ODSS. Moreover, we apply ODSS to a concrete application: influence maximization. We empirically show that our ODSS can improve the complexities of existing influence maximization algorithms on large real-world evolving social networks.

Dynamic Sampling Policy for Subset Selection

Efficient Sampling Policy for Selecting a Subset with the Best

Efficient Sampling Policy for Selecting a Good Enough Subset

Asymptotically Optimal Sampling Policy for Selecting Top-m Alternatives

Dynamic Sampling Allocation for Selecting a Good Enough Alternative.

Dynamic Sampling Allocation and Design Selection.

Dynamic Sampling Allocation under Finite Simulation Budget for Feasibility Determination

Efficient Learning for Selecting Top-m Context-Dependent Designs

Dynamic Sampling For Feasibility Determination

An Efficient Dynamic Sampling Policy for Monte Carlo Tree Search.

Top-Two Thompson Sampling for Contextual Top-mc Selection Problems

Efficient Dynamic Allocation Policy for Robust Ranking and Selection under Stochastic Control Framework

Stochastic Control Framework for Determining Feasible Alternatives in Sampling Allocation

Ranking and Selection as Stochastic Control

Sequential sampling for a ranking and selection problem with exponential sampling distributions

A REVIEW OF STATIC AND DYNAMIC OPTIMIZATION FOR RANKING AND SELECTION

Optimal Dynamic Subset Sampling: Theory and Applications

Efficient Simulation Budget Allocation for Subset Selection Using Regression Metamodels

A Dynamic Framework for Statistical Selection Problems

Myopic Allocation Policy with Asymptotically Optimal Sampling Rate.

Gradient-Based Myopic Allocation Policy: an Efficient Sampling Procedure in a Low-Confidence Scenario.