Abstract:SIAM Journal on Optimization, Volume 31, Issue 3, Page 2111-2140, January 2021. Multistage stochastic programming deals with operational and planning problems that involve a sequence of decisions over time while responding to an uncertain future. Algorithms designed to address multistage stochastic linear programming (MSLP) problems often rely upon scenario trees to represent the underlying stochastic process. When this process exhibits stagewise independence, sampling-based techniques, particularly the stochastic dual dynamic programming algorithm, have received wide acceptance. However, these sampling-based methods still operate with a deterministic representation of the problem which uses the so-called sample average approximation. In this work, we present a sequential sampling approach for MSLP problems that allows the decision process to assimilate newly sampled data recursively. We refer to this method as the stochastic dynamic linear programming (SDLP) algorithm. Since we use sequential sampling, the algorithm does not necessitate a priori representation of uncertainty, through either a scenario tree or sample average approximation, both of which require a knowledge/estimation of the underlying distribution. This method constitutes a generalization of the stochastic decomposition algorithm for two-stage stochastic linear programming models. The approximations used within SDLP may be viewed either through the lens of proximal methods or via regularization. Furthermore, we introduce the notion of basic feasible policies which provide a piecewise affine solution discovery scheme, which is embedded within the optimization algorithm to identify incumbent solutions used in the context of proximal iterations. Finally, we show that the SDLP algorithm provides a sequence of decisions and corresponding value function estimates along a sequence of state trajectories that asymptotically converge to their optimal counterparts, with probability one.

Algorithms for Stochastic Mixed-Integer Programming Models

Multistage Robust Mixed-Integer Optimization under Endogenous Uncertainty

Computing Two-Stage Robust Optimization with Mixed Integer Structures

Stochastic programming with integer variables

Numerical Methods for Convex Multistage Stochastic Optimization

Adaptive Multistage Stochastic Programming

The Scenario Generation Algorithm for Multistage Stochastic Linear Programming

A Decomposition Algorithm for Two-Stage Stochastic Programs with Nonconvex Recourse Functions

Quantitative Stability of Fully Random Two-Stage Stochastic Programs with Mixed-Integer Recourse

Models and model value in stochastic programming

Asymptotic Results of Stochastic Decomposition for Two-Stage Stochastic Quadratic Programming

A Decomposition Method for Distributionally-Robust Two-stage Stochastic Mixed-integer Cone Programs

Multistage Stochastic Unit Commitment Using Stochastic Dual Dynamic Integer Programming

Unified Branch-and-Benders-Cut for two-stage stochastic mixed-integer programs

Stochastic decomposition for risk-averse two-stage stochastic linear programs

Solving a Class of Convex Stochastic Programs Via Monte Carlo Simulation

Solving Two-Stage Stochastic Programs with Endogenous Uncertainty via Random Variable Transformation

An Introductory Tutorial on Stochastic Linear Programming Models

Quantitative Stability of Mixed-Integer Two-Stage Quadratic Stochastic Programs

Approximation Algorithms for Stochastic Combinatorial Optimization Problems

Stochastic Dynamic Linear Programming: A Sequential Sampling Algorithm for Multistage Stochastic Linear Programming