Abstract:Sequential Decision Making under Uncertainty (SDMU) is ubiquitous in many domains such as energy, finance, and supply chains. Some SDMU applications are naturally modeled as Multistage Stochastic Optimization Problems (MSPs), but the resulting optimizations are notoriously challenging from a computational standpoint. Under assumptions of convexity and stage-wise independence of the uncertainty, the resulting optimization can be solved efficiently using Stochastic Dual Dynamic Programming (SDDP). Two-stage Linear Decision Rules (TS-LDRs) have been proposed to solve MSPs without the stage-wise independence assumption. TS-LDRs are computationally tractable, but using a policy that is a linear function of past observations is typically not suitable for non-convex environments arising, for example, in energy systems. This paper introduces a novel approach, Two-Stage General Decision Rules (TS-GDR), to generalize the policy space beyond linear functions, making them suitable for non-convex environments. TS-GDR is a self-supervised learning algorithm that trains the nonlinear decision rules using stochastic gradient descent (SGD); its forward passes solve the policy implementation optimization problems, and the backward passes leverage duality theory to obtain closed-form gradients. The effectiveness of TS-GDR is demonstrated through an instantiation using Deep Recurrent Neural Networks named Two-Stage Deep Decision Rules (TS-DDR). The method inherits the flexibility and computational performance of Deep Learning methodologies to solve SDMU problems generally tackled through large-scale optimization techniques. Applied to the Long-Term Hydrothermal Dispatch (LTHD) problem using actual power system data from Bolivia, the TS-DDR not only enhances solution quality but also significantly reduces computation times by several orders of magnitude.

Two-stage and Lagrangian Dual Decision Rules for Multistage Adaptive Robust Optimization

Multistage Robust Mixed-Integer Optimization under Endogenous Uncertainty

Multistage Distributionally Robust Optimization for Integrated Production and Maintenance Scheduling

Two-Stage Robust Optimization under Decision Dependent Uncertainty

Two-Stage ML-Guided Decision Rules for Sequential Decision Making under Uncertainty

A Machine Learning Approach to Two-Stage Adaptive Robust Optimization

Piecewise constant decision rules via branch-and-bound based scenario detection for integer adjustable robust optimization

Decision bounding problems for two-stage distributionally robust stochastic bilevel optimization

Hybrid strategies using linear and piecewise-linear decision rules for multistage adaptive linear optimization

Multi-Stage Decision Rules for Power Generation & Storage Investments with Performance Guarantees

Bounds for Multistage Mixed-Integer Distributionally Robust Optimization

Scenario-Based Robust Optimization for Two-Stage Decision Making Under Binary Uncertainty

Distributionally Robust Multi-Stage Decision Problem and Satisficing

Risk-Adaptive Local Decision Rules

An Adaptive Three-Stage Algorithm For Solving Adjustable Min-Max-Regret Problems

A Deep Generative Learning Approach for Two-stage Adaptive Robust Optimization

A Note on Piecewise Affine Decision Rules for Robust, Stochastic, and Data-Driven Optimization

Distributionally robust optimization with decision dependent ambiguity sets

Deep Learning for Two-Stage Robust Integer Optimization

Adaptive Multistage Stochastic Programming

Multiple kernel learning-aided robust optimization: Learning algorithm, computational tractability, and usage in multi-stage decision-making