Abstract:SIAM Journal on Optimization, Volume 31, Issue 3, Page 2111-2140, January 2021. Multistage stochastic programming deals with operational and planning problems that involve a sequence of decisions over time while responding to an uncertain future. Algorithms designed to address multistage stochastic linear programming (MSLP) problems often rely upon scenario trees to represent the underlying stochastic process. When this process exhibits stagewise independence, sampling-based techniques, particularly the stochastic dual dynamic programming algorithm, have received wide acceptance. However, these sampling-based methods still operate with a deterministic representation of the problem which uses the so-called sample average approximation. In this work, we present a sequential sampling approach for MSLP problems that allows the decision process to assimilate newly sampled data recursively. We refer to this method as the stochastic dynamic linear programming (SDLP) algorithm. Since we use sequential sampling, the algorithm does not necessitate a priori representation of uncertainty, through either a scenario tree or sample average approximation, both of which require a knowledge/estimation of the underlying distribution. This method constitutes a generalization of the stochastic decomposition algorithm for two-stage stochastic linear programming models. The approximations used within SDLP may be viewed either through the lens of proximal methods or via regularization. Furthermore, we introduce the notion of basic feasible policies which provide a piecewise affine solution discovery scheme, which is embedded within the optimization algorithm to identify incumbent solutions used in the context of proximal iterations. Finally, we show that the SDLP algorithm provides a sequence of decisions and corresponding value function estimates along a sequence of state trajectories that asymptotically converge to their optimal counterparts, with probability one.

Sequential estimation for the multiple linear regression models with balanced loss functions

Sequential estimate for generalized linear models with uncertain number of effective variables

SALSA: Sequential Approximate Leverage-Score Algorithm with Application in Analyzing Big Time Series Data

Refined Risk Bounds for Unbounded Losses via Transductive Priors

Two-stage and purely sequential minimum risk point estimation of the scale parameter of a family of distributions under modified LINEX loss plus sampling cost

A New Sequential Sampling Method for Surrogate Modeling Based on a Hybrid Metric

The Superiority of the Bayes Linear Unbiased Minimum Variance Estimator under Balanced Loss Function

Scalable Statistical Inference in Non-parametric Least Squares

Nonlinear Monte Carlo Method for Imbalanced Data Learning

Stochastic Dynamic Linear Programming: A Sequential Sampling Algorithm for Multistage Stochastic Linear Programming

Estimating variances in time series linear regression models using empirical BLUPs and convex optimization

Adaptive Linear Estimating Equations

A Sequential Monte Carlo Algorithm to Incorporate Model Uncertainty in Bayesian Sequential Design

Smoothed Analysis of Sequential Probability Assignment

Sparse Linear Regression With Missing Data

A Single-Timescale Analysis For Stochastic Approximation With Multiple Coupled Sequences

Optimal sampling for stochastic and natural gradient descent

Sequential Monte Carlo with Highly Informative Observations

Sequential sparse Bayesian learning with applications to system identification for damage assessment and recursive reconstruction of image sequences

Sequential Nonparametric Regression

Estimating Stochastic Linear Combination of Non-Linear Regressions Efficiently and Scalably