Abstract:Stochastic optimization has established itself as a major method to handle uncertainty in various optimization problems by modeling the uncertainty by a probability distribution over possible realizations. Traditionally, the main focus in stochastic optimization has been various stochastic mathematical programming (such as linear programming, convex programming). In recent years, there has been a surge of interest in stochastic combinatorial optimization problems from the theoretical computer science community. In this article, we survey some of the recent results on various stochastic versions of classical combinatorial optimization problems. Since most problems in this domain are NP-hard (or #P-hard, or even PSPACE-hard), we focus on the results which provide polynomial time approximation algorithms with provable approximation guarantees. Our discussions are centered around a few representative problems, such as stochastic knapsack, stochastic matching, multi-armed bandit etc. We use these examples to introduce several popular stochastic models, such as the fixed-set model, 2-stage stochastic optimization model, stochastic adaptive probing model etc, as well as some useful techniques for designing approximation algorithms for stochastic combinatorial optimization problems, including the linear programming relaxation approach, boosted sampling, content resolution schemes, Poisson approximation etc. We also provide some open research questions along the way. Our purpose is to provide readers a quick glimpse to the models, problems, and techniques in this area, and hopefully inspire new contributions

Statistical Methods for Optimization

An Efficient Latent Variable Optimization Approach with Stochastic Constraints for Complex Industrial Process

Robust Optimization Using a Methodology Based on Cross Entropy Methods

Design and Analysis of Optimization Algorithms Using Computational Statistics

A Statistical Perspective on Linear Programs with Uncertain Parameters

A New Methodology for Robust Optimizations of Optimal Design Problems under Interval Uncertainty

Chapter 2 Discrete Optimization via Simulation

Learning-Based Robust Optimization: Procedures and Statistical Guarantees

A REVIEW OF STATIC AND DYNAMIC OPTIMIZATION FOR RANKING AND SELECTION

An introduction to optimization under uncertainty -- A short survey

Better Solution Principle: A Facet of Concordance between Optimization and Statistics

Asymptotic Optimality in Stochastic Optimization

A Bayesian Risk Approach to Data-driven Stochastic Optimization: Formulations and Asymptotics

Selecting the Best System when Systems Are Revealed Sequentially

Approximation Algorithms for Stochastic Combinatorial Optimization Problems

Managing Distributional Ambiguity in Stochastic Optimization through a Statistical Upper Bound Framework

Optimal Computing Budget Allocation for Data-driven Ranking and Selection

Ranking and Selection as Stochastic Control

A survey of decision making and optimization under uncertainty

A Note On The Popularity of Stochastic Optimization Algorithms in Different Fields: A Quantitative Analysis from 2007 to 2017

Bayesian Optimization for Non-Convex Two-Stage Stochastic Optimization Problems