Abstract:We study several stochastic combinatorial problems, including the expected utility maximization problem, the stochastic knapsack problem and the stochastic bin packing problem. A common technical challenge in these problems is to optimize some function (other than the expectation) of the sum of a set of random variables. The difficulty is mainly due to the fact that the probability distribution of the sum is the convolution of a set of distributions, which is not an easy objective function to work with. To tackle this difficulty, we introduce the Poisson approximation technique. The technique is based on the Poisson approximation theorem discovered by Le Cam, which enables us to approximate the distribution of the sum of a set of random variables using a compound Poisson distribution. Using the technique, we can reduce a variety of stochastic problems to the corresponding deterministic multiple-objective problems, which either can be solved by standard dynamic programming or have known solutions in the literature. For the problems mentioned above, we obtain the following results: We first study the expected utility maximization problem introduced recently [Li and Despande, FOCS11]. For monotone and Lipschitz utility functions, we obtain an additive PTAS if there is a multidimensional PTAS for the multi-objective version of the problem, strictly generalizing the previous result. The result implies the first additive PTAS for maximizing threshold probability for the stochastic versions of global min-cut, matroid base and matroid intersection. For the stochastic bin packing problem (introduced in [Kleinberg, Rabani and Tardos, STOC97]), we show there is a polynomial time algorithm which uses at most the optimal number of bins, if we relax the size of each bin and the overflow probability by e for any constant ε>0. Based on this result, we obtain a 3-approximation if only the size of each bin can be relaxed by ε, improving the known O(1/ε) factor for constant overflow probability. For stochastic knapsack, we show a (1+ε)-approximation using ε extra capacity for any ε>0, even when the size and reward of each item may be correlated and cancelations of items are allowed. This generalizes the previous work [Balghat, Goel and Khanna, SODA11] for the case without correlation and cancelation. Our algorithm is also simpler. We also present a factor 2+ε approximation algorithm for stochastic knapsack with cancelations, for any constant ε>0, improving the current known approximation factor of 8 [Gupta, Krishnaswamy, Molinaro and Ravi, FOCS11]. We also study an interesting variant of the stochastic knapsack problem, where the size and the profit of each item are revealed before the decision is made. The problem falls into the framework of Bayesian online selection problems, which has been studied a lot recently.

Efficient optimal Kolmogorov approximation of random variables

Stochastic Combinatorial Optimization Via Poisson Approximation

Approximation Algorithms for Stochastic Combinatorial Optimization Problems

Formalization of a Stochastic Approximation Theorem

Approximating the Expected Values for Combinatorial Optimization Problems over Stochastic Points.

An Additively Optimal Interpreter for Approximating Kolmogorov Prefix Complexity

Approximation Algorithms for Combinatorial Optimization with Predictions

Almost-sure quasi-optimal approximation in reproducing kernel Hilbert spaces

A Fully Polynomial-Time Approximation Scheme for Approximating a Sum of Random Variables

Optimal Coding for Randomized Kolmogorov Complexity and Its Applications

Stochastic Combinatorial Optimization under Probabilistic Constraints

Kolmogorov Width Decay and Poor Approximators in Machine Learning: Shallow Neural Networks, Random Feature Models and Neural Tangent Kernels

Computationally Efficient Approximations for Distributionally Robust Optimization Under Moment and Wasserstein Ambiguity

Efficient randomized tensor-based algorithms for function approximation and low-rank kernel interactions

Approximation Algorithms for Stochastic Clustering

Randomized Algorithms for the Approximations of Tucker and the Tensor Train Decompositions.

Approximation Algorithms for Min-max-min Robust Optimization and K-Adaptability under Objective Uncertainty

Optimal approximation of infinite-dimensional holomorphic functions

Optimal Approximate Sampling from Discrete Probability Distributions

Robust Approximation Algorithms for Non-monotone $k$-Submodular Maximization under a Knapsack Constraint