Abstract:SIAM Journal on Optimization, Volume 31, Issue 3, Page 2111-2140, January 2021. Multistage stochastic programming deals with operational and planning problems that involve a sequence of decisions over time while responding to an uncertain future. Algorithms designed to address multistage stochastic linear programming (MSLP) problems often rely upon scenario trees to represent the underlying stochastic process. When this process exhibits stagewise independence, sampling-based techniques, particularly the stochastic dual dynamic programming algorithm, have received wide acceptance. However, these sampling-based methods still operate with a deterministic representation of the problem which uses the so-called sample average approximation. In this work, we present a sequential sampling approach for MSLP problems that allows the decision process to assimilate newly sampled data recursively. We refer to this method as the stochastic dynamic linear programming (SDLP) algorithm. Since we use sequential sampling, the algorithm does not necessitate a priori representation of uncertainty, through either a scenario tree or sample average approximation, both of which require a knowledge/estimation of the underlying distribution. This method constitutes a generalization of the stochastic decomposition algorithm for two-stage stochastic linear programming models. The approximations used within SDLP may be viewed either through the lens of proximal methods or via regularization. Furthermore, we introduce the notion of basic feasible policies which provide a piecewise affine solution discovery scheme, which is embedded within the optimization algorithm to identify incumbent solutions used in the context of proximal iterations. Finally, we show that the SDLP algorithm provides a sequence of decisions and corresponding value function estimates along a sequence of state trajectories that asymptotically converge to their optimal counterparts, with probability one.

The Scenario Generation Algorithm for Multistage Stochastic Linear Programming

Optimized Scenario Reduction: Solving Large-Scale Stochastic Programs with Quality Guarantees

Stochastic Dynamic Linear Programming: A Sequential Sampling Algorithm for Multistage Stochastic Linear Programming

A Novel Method for Multistage Scenario Generation Based on Cluster Analysis.

Scenario generation by selection from historical data

Scenario Reduction Algorithms in Stochastic Programming

Numerical Methods for Convex Multistage Stochastic Optimization

Algorithms for Stochastic Mixed-Integer Programming Models

Stochastic Constraint Programming: A Scenario-Based Approach

Column generation for multistage stochastic mixed-integer nonlinear programs with discrete state variables

Stochastic Successive Convex Approximation for Non-Convex Constrained Stochastic Optimization

Efficient Scenario Generation for Heavy-tailed Chance Constrained Optimization

Stochastic dual dynamic programming for multistage stochastic mixed-integer nonlinear optimization

Dynamic stochastic approximation for multi-stage stochastic optimization

Exact Quantization of Multistage Stochastic Linear Problems

Adaptive Multistage Stochastic Programming

Scenario-decomposition Solution Framework for Nonseparable Stochastic Control Problems

Global optimization of multiscenario mixed integer nonlinear programming models arising in the synthesis of integrated water networks under uncertainty

The Scenario Approach for Stochastic Model Predictive Control with Bounds on Closed-Loop Constraint Violations

Multistage Stochastic Unit Commitment Using Stochastic Dual Dynamic Integer Programming

A General Scenario Theory for Nonconvex Optimization and Decision Making