Abstract:We present StochasticPrograms.jl, a user-friendly and powerful open-source framework for stochastic programming written in the Julia language. The framework includes both modeling tools and structure-exploiting optimization algorithms. Stochastic programming models can be efficiently formulated using an expressive syntax, and models can be instantiated, inspected, and analyzed interactively. The framework scales seamlessly to distributed environments. Small instances of a model can be run locally to ensure correctness, whereas larger instances are automatically distributed in a memory-efficient way onto supercomputers or clouds and solved using parallel optimization algorithms. These structure-exploiting solvers are based on variations of the classical L-shaped, progressive-hedging, and quasi-gradient algorithms. We provide a concise mathematical background for the various tools and constructs available in the framework along with code listings exemplifying their usage. Both software innovations related to the implementation of the framework and algorithmic innovations related to the structured solvers are highlighted. We conclude by demonstrating strong scaling properties of the distributed algorithms on numerical benchmarks in a multinode setup. Summary of Contribution: This paper presents StochasticPrograms.jl, an open-source framework for stochastic programming implemented in the Julia programming language. The framework includes an expressive syntax for formulating stochastic programming models as well as versatile analysis tools and parallel optimization algorithms. The framework will prove useful to researchers, educators, and industrial users alike. Researchers will benefit from the readily extensible open-source framework, in which they can formulate complex stochastic models or quickly typeset and test novel optimization algorithms. Educators of stochastic programming will benefit from the clean and expressive syntax. Moreover, the framework supports analysis tools and stochastic programming constructs from classical theory and leading textbooks. We strongly believe that the StochasticPrograms.jl framework can reduce the barrier to entry for incoming practitioners of stochastic programming. Industrial practitioners can make use of StochasticPrograms.jl to rapidly formulate complex models, analyze small instances locally, and then run large-scale instances in production. In doing so, they get distributed capabilities for free without changing the code and access to well-tested state-of-the-art implementations of parallel structure-exploiting solvers. As the framework is open-source, anyone from these target audiences can contribute with new functionality to the framework. In conclusion, by providing both an intuitive interface for new users and an extensive development environment for expert users, StochasticPrograms.jl has strong potential to further the field of stochastic programming.

Julia: A Fast Dynamic Language for Technical Computing

Julia: dynamism and performance reconciled by design

Julia: A Fresh Approach to Numerical Computing

Potential of the Julia programming language for high energy physics computing

Julia: come for the syntax, stay for the speed

Julia as a unifying end-to-end workflow language on the Frontier exascale system

Rust and Julia for Scientific Computing

Computer algebra in Julia

Bridging HPC Communities through the Julia Programming Language

The State of Julia for Scientific Machine Learning

DynamicPPL: Stan-like Speed for Dynamic Probabilistic Models

A Type System for Julia

Julia language in machine learning: Algorithms, applications, and open issues

Practical partial evaluation for high-performance dynamic language runtimes

Efficient Stochastic Programming in Julia

Bridging Worlds: Achieving Language Interoperability between Julia and Python in Scientific Computing

Advancing The Robotics Software Development Experience: Bridging Julia's Performance and Python's Ecosystem

Julia Cloud Matrix Machine: Dynamic Matrix Language Acceleration on Multicore Clusters in the Cloud

Performant Dynamically Typed E-Graphs in Pure Julia

World Age in Julia: Optimizing Method Dispatch in the Presence of Eval (Extended Version)

Intrepydd: performance, productivity, and portability for data science application kernels