Abstract:We present StochasticPrograms.jl, a user-friendly and powerful open-source framework for stochastic programming written in the Julia language. The framework includes both modeling tools and structure-exploiting optimization algorithms. Stochastic programming models can be efficiently formulated using an expressive syntax, and models can be instantiated, inspected, and analyzed interactively. The framework scales seamlessly to distributed environments. Small instances of a model can be run locally to ensure correctness, whereas larger instances are automatically distributed in a memory-efficient way onto supercomputers or clouds and solved using parallel optimization algorithms. These structure-exploiting solvers are based on variations of the classical L-shaped, progressive-hedging, and quasi-gradient algorithms. We provide a concise mathematical background for the various tools and constructs available in the framework along with code listings exemplifying their usage. Both software innovations related to the implementation of the framework and algorithmic innovations related to the structured solvers are highlighted. We conclude by demonstrating strong scaling properties of the distributed algorithms on numerical benchmarks in a multinode setup. Summary of Contribution: This paper presents StochasticPrograms.jl, an open-source framework for stochastic programming implemented in the Julia programming language. The framework includes an expressive syntax for formulating stochastic programming models as well as versatile analysis tools and parallel optimization algorithms. The framework will prove useful to researchers, educators, and industrial users alike. Researchers will benefit from the readily extensible open-source framework, in which they can formulate complex stochastic models or quickly typeset and test novel optimization algorithms. Educators of stochastic programming will benefit from the clean and expressive syntax. Moreover, the framework supports analysis tools and stochastic programming constructs from classical theory and leading textbooks. We strongly believe that the StochasticPrograms.jl framework can reduce the barrier to entry for incoming practitioners of stochastic programming. Industrial practitioners can make use of StochasticPrograms.jl to rapidly formulate complex models, analyze small instances locally, and then run large-scale instances in production. In doing so, they get distributed capabilities for free without changing the code and access to well-tested state-of-the-art implementations of parallel structure-exploiting solvers. As the framework is open-source, anyone from these target audiences can contribute with new functionality to the framework. In conclusion, by providing both an intuitive interface for new users and an extensive development environment for expert users, StochasticPrograms.jl has strong potential to further the field of stochastic programming.

Software for Data-Based Stochastic Programming Using Bootstrap Estimation

Two-Stage Bootstrap Sampling for Probabilistic Load Forecasting

A Shrinkage Approach to Improve Direct Bootstrap Resampling Under Input Uncertainty

Estimation and Inference by Stochastic Optimization: Three Examples

Stochastic decomposition for risk-averse two-stage stochastic linear programs

The Big Data Bootstrap

Data-driven Two-Stage Stochastic Programming for Utility System Optimization under Uncertainty

A Data-Driven Approach to Multistage Stochastic Linear Optimization

Bootstrap SGD: Algorithmic Stability and Robustness

Optimal Subsampling Bootstrap for Massive Data

The Bootstrap for Dynamical Systems

Robust Stochastic Approximation Approach to Stochastic Programming

A Statistical Perspective on Linear Programs with Uncertain Parameters

Adaptive and nonadaptive approaches to statistically based methods for solving stochastic linear programs: a computational investigation

Scalable Statistical Inference in Non-parametric Least Squares

A Subsampled Double Bootstrap for Massive Data

Efficient Stochastic Programming in Julia

Managing Distributional Ambiguity in Stochastic Optimization through a Statistical Upper Bound Framework

Treatment bootstrapping: A new approach to quantify uncertainty of average treatment effect estimates

Stochastic Optimization with Parametric Cost Function Approximations

A Bayesian Risk Approach to Data-driven Stochastic Optimization: Formulations and Asymptotics