Abstract:SIAM Journal on Optimization, Volume 31, Issue 3, Page 2111-2140, January 2021. Multistage stochastic programming deals with operational and planning problems that involve a sequence of decisions over time while responding to an uncertain future. Algorithms designed to address multistage stochastic linear programming (MSLP) problems often rely upon scenario trees to represent the underlying stochastic process. When this process exhibits stagewise independence, sampling-based techniques, particularly the stochastic dual dynamic programming algorithm, have received wide acceptance. However, these sampling-based methods still operate with a deterministic representation of the problem which uses the so-called sample average approximation. In this work, we present a sequential sampling approach for MSLP problems that allows the decision process to assimilate newly sampled data recursively. We refer to this method as the stochastic dynamic linear programming (SDLP) algorithm. Since we use sequential sampling, the algorithm does not necessitate a priori representation of uncertainty, through either a scenario tree or sample average approximation, both of which require a knowledge/estimation of the underlying distribution. This method constitutes a generalization of the stochastic decomposition algorithm for two-stage stochastic linear programming models. The approximations used within SDLP may be viewed either through the lens of proximal methods or via regularization. Furthermore, we introduce the notion of basic feasible policies which provide a piecewise affine solution discovery scheme, which is embedded within the optimization algorithm to identify incumbent solutions used in the context of proximal iterations. Finally, we show that the SDLP algorithm provides a sequence of decisions and corresponding value function estimates along a sequence of state trajectories that asymptotically converge to their optimal counterparts, with probability one.

A Sampling-based Progressive Hedging Algorithm for Stochastic Programming

Convergence Analysis of a Stochastic Progressive Hedging Algorithm for Stochastic Programming

A Progressive Hedging-Based Solution Approach for Integrated Planning and Scheduling Problems under Demand Uncertainty

A Note on Progressive Hedging Algorithm for Multistage Stochastic Variational Inequalities

A Localized Progressive Hedging Algorithm for Solving Nonmonotone Stochastic Variational Inequalities

Adapting Progressive Hedging for Solving Two-Stage Stochastic Programs Under a Peer-to-Peer Computing Network

Solving Stochastic Programming Problems with Risk Measures by Progressive Hedging

Strong Convergence of Relaxed Inertial Inexact Progressive Hedging Algorithm for Multi-stage Stochastic Variational Inequality Problems

Application of Modified Progressive Hedging for Stochastic Unit Commitment in Electricity-Gas Coupled Systems

Neural-Progressive Hedging: Enforcing Constraints in Reinforcement Learning with Stochastic Programming

Stochastic Day-Ahead Scheduling of ElectricityGas Coupled Systems via Progressive Hedging

Robust stochastic optimization via regularized PHA: application to Energy Management Systems

Adaptive and nonadaptive approaches to statistically based methods for solving stochastic linear programs: a computational investigation

Stochastic Dynamic Linear Programming: A Sequential Sampling Algorithm for Multistage Stochastic Linear Programming

Solving monotone stochastic variational inequalities and complementarity problems by progressive hedging

A Sequential Sampling Procedure for Stochastic Programming

Global Convergence of A General Sampling Algorithm for Dynamic Nonlinear Stochastic Programs

Risk-Averse Optimal Control Model Under Uncertainty and Its Modified Progressive Hedging Algorithm

An Adaptive Sampling Augmented Lagrangian Method for Stochastic Optimization with Deterministic Constraints

Delayed Sampling Approach to Stochastic Programming in Chemical Processes

Sampling-based Pareto Optimization for Chance-constrained Monotone Submodular Problems