Abstract:We establish a broad methodological foundation for mixed-integer optimization with learned constraints. We propose an end-to-end pipeline for data-driven decision making in which constraints and objectives are directly learned from data using machine learning, and the trained models are embedded in an optimization formulation. We exploit the mixed-integer optimization-representability of many machine learning methods, including linear models, decision trees, ensembles, and multi-layer perceptrons, which allows us to capture various underlying relationships between decisions, contextual variables, and outcomes. We also introduce two approaches for handling the inherent uncertainty of learning from data. First, we characterize a decision trust region using the convex hull of the observations, to ensure credible recommendations and avoid extrapolation. We efficiently incorporate this representation using column generation and propose a more flexible formulation to deal with low-density regions and high-dimensional datasets. Then, we propose an ensemble learning approach that enforces constraint satisfaction over multiple bootstrapped estimators or multiple algorithms. In combination with domain-driven components, the embedded models and trust region define a mixed-integer optimization problem for prescription generation. We implement this framework as a Python package (OptiCL) for practitioners. We demonstrate the method in both World Food Programme planning and chemotherapy optimization. The case studies illustrate the framework's ability to generate high-quality prescriptions as well as the value added by the trust region, the use of ensembles to control model robustness, the consideration of multiple machine learning methods, and the inclusion of multiple learned constraints.

A Knowledge Representation Approach to Automated Mathematical Modelling

Knowledge engineering mixed-integer linear programming: constraint typology

Mathematical knowledge management method based on neutral model representation

A multi-level approach to ubiquitous modeling and solving constraints in combinatorial optimization problems in production and distribution

OptiMUS: Scalable Optimization Modeling with (MI)LP Solvers and Large Language Models

Obtaining Efficient Solutions of Interval Multi-objective Linear Programming Problems

A Knowledge-Based Creation of Mathematical Programming for GIS Problem Solving

OptiMUS-0.3: Using Large Language Models to Model and Solve Optimization Problems at Scale

Generalized Optimization Modulo Theories

Mixed-Integer Optimization with Constraint Learning

Multi-objective mixed integer programming and an application in a pharmaceutical supply chain

A fast MILP solver for high-level synthesis based on heuristic model reduction and enhanced branch and bound algorithm

Multi-objective Integer Programming Approaches for Solving the Multi-criteria Test-suite Minimization Problem

Mathematical Modeling of Scheduling Problems

Multi-objective Integer Programming Approaches for Solving the Multi-criteria Test-suite Minimization Problem: Towards Sound and Complete Solutions of a Particular Search-based Software-engineering Problem

Optimizing supply chain networks using mixed integer linear programming (MILP)

Machine Learning Augmented Branch and Bound for Mixed Integer Linear Programming

A Novel MILP Model Based on the Topology of a Network Graph for Process Planning in an Intelligent Manufacturing System

Towards Foundation Models for Mixed Integer Linear Programming

Unifying Framework for Optimizations in Non-Boolean Formalisms

A bi-objective MILP model for blocking hybrid flexible flow shop scheduling problem: robust possibilistic programming approach