Abstract:SIAM Journal on Optimization, Volume 31, Issue 3, Page 2111-2140, January 2021. Multistage stochastic programming deals with operational and planning problems that involve a sequence of decisions over time while responding to an uncertain future. Algorithms designed to address multistage stochastic linear programming (MSLP) problems often rely upon scenario trees to represent the underlying stochastic process. When this process exhibits stagewise independence, sampling-based techniques, particularly the stochastic dual dynamic programming algorithm, have received wide acceptance. However, these sampling-based methods still operate with a deterministic representation of the problem which uses the so-called sample average approximation. In this work, we present a sequential sampling approach for MSLP problems that allows the decision process to assimilate newly sampled data recursively. We refer to this method as the stochastic dynamic linear programming (SDLP) algorithm. Since we use sequential sampling, the algorithm does not necessitate a priori representation of uncertainty, through either a scenario tree or sample average approximation, both of which require a knowledge/estimation of the underlying distribution. This method constitutes a generalization of the stochastic decomposition algorithm for two-stage stochastic linear programming models. The approximations used within SDLP may be viewed either through the lens of proximal methods or via regularization. Furthermore, we introduce the notion of basic feasible policies which provide a piecewise affine solution discovery scheme, which is embedded within the optimization algorithm to identify incumbent solutions used in the context of proximal iterations. Finally, we show that the SDLP algorithm provides a sequence of decisions and corresponding value function estimates along a sequence of state trajectories that asymptotically converge to their optimal counterparts, with probability one.

Solving Multistage Stochastic Linear Programming via Regularized Linear Decision Rules: An Application to Hydrothermal Dispatch Planning

Two-Stage ML-Guided Decision Rules for Sequential Decision Making under Uncertainty

Multi-Stage Decision Rules for Power Generation & Storage Investments with Performance Guarantees

RL-ISLAP: A Reinforcement Learning Framework for Industrial-Scale Linear Assignment Problems at Alipay

Dealing with Negative Inflows in the Long-Term Hydrothermal Scheduling Problem

Hybrid strategies using linear and piecewise-linear decision rules for multistage adaptive linear optimization

Nonconvex Medium-Term Hydropower Scheduling by Stochastic Dual Dynamic Integer Programming

Stochastic Dynamic Linear Programming: A Sequential Sampling Algorithm for Multistage Stochastic Linear Programming

Data‐driven robust look‐ahead power dispatch with preidentification of the worst‐case scenario using combined multilayer perceptron

Multi-Stage Dispatch of Seaport Power Systems for Incorporating Logistical Flexibilities in Uncertain Operational Conditions

Improving operating policies in stochastic optimization: An application to the medium-term hydrothermal scheduling problem

Multiple stage stochastic linear programming with multiple objectives: flexible decision making

A Stochastic MILP Model for Long-Term Hydrothermal Scheduling Considering Water Resource Management

Two-stage and Lagrangian Dual Decision Rules for Multistage Adaptive Robust Optimization

Learning-based Two-tiered Online Optimization of Region-wide Datacenter Resource Allocation

Markov Chain-based Policies for Multi-stage Stochastic Integer Linear Programming with an Application to Disaster Relief Logistics

Economic dispatch of power systems with LMP-dependent demands: A non-iterative MILP model

Solving Stackelberg Prediction Game with Least Squares Loss Via Spherically Constrained Least Squares Reformulation

Multi-Stage Robust Optimization of Real-Time Dynamic Dispatch with Fast-Acting Units in Resilient Power Systems

An ADMM-LSTM framework for short-term load forecasting

Reinforcement Learning and Mixed-Integer Programming for Power Plant Scheduling in Low Carbon Systems: Comparison and Hybridisation