Abstract:Dynamic stochastic optimization models provide a powerful tool to represent sequential decision-making processes. Typically, these models use statistical predictive methods to capture the structure of the underlying stochastic process without taking into consideration estimation errors and model misspecification. In this context, we propose a data-driven prescriptive analytics framework aiming to integrate the machine learning and dynamic optimization machinery in a consistent and efficient way to build a bridge from data to decisions. The proposed framework tackles a relevant class of dynamic decision problems comprising many important practical applications. The basic building blocks of our proposed framework are: (1) a Hidden Markov Model as a predictive (machine learning) method to represent uncertainty; and (2) a distributionally robust dynamic optimization model as a prescriptive method that takes into account estimation errors associated with the predictive model and allows for control of the risk associated with decisions. Moreover, we present an evaluation framework to assess out-of-sample performance in rolling horizon schemes. A complete case study on dynamic asset allocation illustrates the proposed framework showing superior out-of-sample performance against selected benchmarks. The numerical results show the practical importance and applicability of the proposed framework since it extracts valuable information from data to obtain robustified decisions with an empirical certificate of out-of-sample performance evaluation.

A Dynamic Framework for Statistical Selection Problems

Dynamic Sampling Allocation and Design Selection.

Efficient Sampling Policy for Selecting a Subset with the Best

Ranking and Selection as Stochastic Control

Efficient Sampling Policy for Selecting a Good Enough Subset

Dynamic Sampling Allocation for Selecting a Good Enough Alternative.

Stochastic Control Framework for Determining Feasible Alternatives in Sampling Allocation

A REVIEW OF STATIC AND DYNAMIC OPTIMIZATION FOR RANKING AND SELECTION

Efficient Dynamic Allocation Policy for Robust Ranking and Selection under Stochastic Control Framework

A New Framework of Designing Sequential Ranking-and-selection Procedures.

Myopic Allocation Policy with Asymptotically Optimal Sampling Rate.

Dynamic Sampling Policy for Subset Selection

Dynamic Sampling For Feasibility Determination

Context-Dependent Ranking and Selection under a Bayesian Framework

Efficient Sampling Allocation Procedures for Optimal Quantile Selection

Efficient Learning for Selecting Top-m Context-Dependent Designs

A data-driven approach for a class of stochastic dynamic optimization problems

Sequential sampling for a ranking and selection problem with exponential sampling distributions

Selective Randomization Inference for Adaptive Experiments

Asymptotically Optimal Sampling Policy for Selecting Top-m Alternatives

Top-Two Thompson Sampling for Selecting Context-Dependent Best Designs.