Abstract:Optimization problems involving sequential decisions in a stochastic environment were studied in Stochastic Programming (SP), Stochastic Optimal Control (SOC) and Markov Decision Processes (MDP). In this paper we mainly concentrate on SP and SOC modelling approaches. In these frameworks there are natural situations when the considered problems are convex. Classical approach to sequential optimization is based on dynamic programming. It has the problem of the so-called ``Curse of Dimensionality", in that its computational complexity increases exponentially with increase of dimension of state variables. Recent progress in solving convex multistage stochastic problems is based on cutting planes approximations of the cost-to-go (value) functions of dynamic programming equations. Cutting planes type algorithms in dynamical settings is one of the main topics of this paper. We also discuss Stochastic Approximation type methods applied to multistage stochastic optimization problems. From the computational complexity point of view, these two types of methods seem to be complimentary to each other. Cutting plane type methods can handle multistage problems with a large number of stages, but a relatively smaller number of state (decision) variables. On the other hand, stochastic approximation type methods can only deal with a small number of stages, but a large number of decision variables.

A NEW DETERMINISTIC FORMULATION FOR DYNAMIC STOCHASTIC PROGRAMMING PROBLEMS AND ITS NUMERICAL COMPARISON WITH OTHERS

A NEW METHOD FOR OPTIMIZING DYNAMIC SYSTEM WITH STATE CONSTRAINTS AND ITS APPLICATION TO THE GENERATION UNITS SCHEDULING

Discrete Approximation and Convergence Analysis for a Class of Decision-Dependent Two-Stage Stochastic Linear Programs

Compound Dynamic Constraint Of Stochastic Optimization Model And Algorithm

Information Relaxation and A Duality-Driven Algorithm for Stochastic Dynamic Programs

Modeling and Algorithm for Dynamic Vehicle Scheduling Problems

Formulation and application of weight-function-based physical programming

An Efficient Neurodynamic Approach to Fuzzy Chance-constrained Programming

Efficient Dynamic Allocation Policy for Robust Ranking and Selection under Stochastic Control Framework

Chance Constrained Programming Models for Intelligent Scheduling Problems and Their Efficient Solution

Stochastic transportation programming model based on effect synthesis

A Stochastic Programming Based Method for Hospital Site Selection

Resource Constrained Stochastic Job Scheduling Based on Dynamic Programming

AN IMPROVED DYNAMIC PROGRAMMING METHOD FOR DETERMINING UNIT COMMITMENT

Stochastic Programming Model Based on Compound Quantification and Its Application in Transportation Problems.

A Successive Refinement for Solving Stochastic Programs with Decision-Dependent Random Capacities

Balance Programming Between Target And Chance With Application In Building Optimal Bidding Strategies For Generation Companies

New Valid Inequalities and Formulations for the Static Joint Chance-constrained Lot-sizing Problem.

Numerical Methods for Convex Multistage Stochastic Optimization

Relationship between stochastic maximum principle and dynamic programming principle under convex expectation

Improved Dynamic Programming Methods for Optimal Control of Lumped-Parameter Stochastic Systems