Abstract:We present StochasticPrograms.jl, a user-friendly and powerful open-source framework for stochastic programming written in the Julia language. The framework includes both modeling tools and structure-exploiting optimization algorithms. Stochastic programming models can be efficiently formulated using an expressive syntax, and models can be instantiated, inspected, and analyzed interactively. The framework scales seamlessly to distributed environments. Small instances of a model can be run locally to ensure correctness, whereas larger instances are automatically distributed in a memory-efficient way onto supercomputers or clouds and solved using parallel optimization algorithms. These structure-exploiting solvers are based on variations of the classical L-shaped, progressive-hedging, and quasi-gradient algorithms. We provide a concise mathematical background for the various tools and constructs available in the framework along with code listings exemplifying their usage. Both software innovations related to the implementation of the framework and algorithmic innovations related to the structured solvers are highlighted. We conclude by demonstrating strong scaling properties of the distributed algorithms on numerical benchmarks in a multinode setup. Summary of Contribution: This paper presents StochasticPrograms.jl, an open-source framework for stochastic programming implemented in the Julia programming language. The framework includes an expressive syntax for formulating stochastic programming models as well as versatile analysis tools and parallel optimization algorithms. The framework will prove useful to researchers, educators, and industrial users alike. Researchers will benefit from the readily extensible open-source framework, in which they can formulate complex stochastic models or quickly typeset and test novel optimization algorithms. Educators of stochastic programming will benefit from the clean and expressive syntax. Moreover, the framework supports analysis tools and stochastic programming constructs from classical theory and leading textbooks. We strongly believe that the StochasticPrograms.jl framework can reduce the barrier to entry for incoming practitioners of stochastic programming. Industrial practitioners can make use of StochasticPrograms.jl to rapidly formulate complex models, analyze small instances locally, and then run large-scale instances in production. In doing so, they get distributed capabilities for free without changing the code and access to well-tested state-of-the-art implementations of parallel structure-exploiting solvers. As the framework is open-source, anyone from these target audiences can contribute with new functionality to the framework. In conclusion, by providing both an intuitive interface for new users and an extensive development environment for expert users, StochasticPrograms.jl has strong potential to further the field of stochastic programming.

Julia language in machine learning: Algorithms, applications, and open issues

The State of Julia for Scientific Machine Learning

Julia: A Fresh Approach to Numerical Computing

Computer algebra in Julia

A survey on HHL algorithm: From theory to application in quantum machine learning

Julia: dynamism and performance reconciled by design

Bridging HPC Communities through the Julia Programming Language

Potential of the Julia programming language for high energy physics computing

Research on Machine Learning with Algorithms and Development

Julia: A Fast Dynamic Language for Technical Computing

Fairness in Machine Learning: Definition, Testing, Debugging, and Application

A Comprehensive Overview of Machine Learning Algorithms and their Applications

Julearn: an easy-to-use library for leakage-free evaluation and inspection of ML models

Classical Machine Learning: Seventy Years of Algorithmic Learning Evolution

Julia as a unifying end-to-end workflow language on the Frontier exascale system

Machine Learning Testing: Survey, Landscapes and Horizons

Machine Learning Algorithms and Its Applications: A Survey

Efficient Stochastic Programming in Julia

Machine learning: recent progress in China and beyond

Machine learning and the physical sciences

Research on feature coding theory and typical application analysis in machine learning algorithms