Abstract:Mixed-integer non-linear programs (MINLPs) arise in various domains, such as energy systems and transportation, but are notoriously difficult to solve. Recent advances in machine learning have led to remarkable successes in optimization tasks, an area broadly known as learning to optimize. This approach includes using predictive models to generate solutions for optimization problems with continuous decision variables, thereby avoiding the need for computationally expensive optimization algorithms. However, applying learning to MINLPs remains challenging primarily due to the presence of integer decision variables, which complicate gradient-based learning. To address this limitation, we propose two differentiable correction layers that generate integer outputs while preserving gradient information. Combined with a soft penalty for constraint violation, our framework can tackle both the integrality and non-linear constraints in a MINLP. Experiments on three problem classes with convex/non-convex objective/constraints and integer/mixed-integer variables show that the proposed learning-based approach consistently produces high-quality solutions for parametric MINLPs extremely quickly. As problem size increases, traditional exact solvers and heuristic methods struggle to find feasible solutions, whereas our approach continues to deliver reliable results. Our work extends the scope of learning-to-optimize to MINLP, paving the way for integrating integer constraints into deep learning models. Our code is available at <a class="link-external link-https" href="https://github.com/pnnl/L2O-pMINLP" rel="external noopener nofollow">this https URL</a>.

Actively Learning Combinatorial Optimization Using a Membership Oracle

Learning for Robust Combinatorial Optimization: Algorithm and Application

Saddle Point Optimization with Approximate Minimization Oracle and Its Application to Robust Berthing Control

USCO-Solver: Solving Undetermined Stochastic Combinatorial Optimization Problems

Oracle-Based Robust Optimization via Online Learning

Proximal Oracles for Optimization and Sampling

A Survey for Solving Mixed Integer Programming via Machine Learning

SurCo: Learning Linear Surrogates For Combinatorial Nonlinear Optimization Problems

Dynamic Strongly Convex Sparse Operator with Learning Mechanism for Sparse Large-Scale Multi-Objective Optimization

An Adaptive Constraint-Handling Approach for Optimization Problems with Expensive Objective and Constraints

Learning to Optimize for Mixed-Integer Non-linear Programming

Learning to project in a criterion space search algorithm: an application to multi-objective binary linear programming

The Complexity of Large-scale Convex Programming under a Linear Optimization Oracle

Using Combinatorial Optimization to Design a High quality LLM Solution

Oracle Efficient Private Non-Convex Optimization

Achieving Diversity in Objective Space for Sample-efficient Search of Multiobjective Optimization Problems

Machine Learning Augmented Branch and Bound for Mixed Integer Linear Programming

Learning to Solve Combinatorial Optimization under Positive Linear Constraints via Non-Autoregressive Neural Networks

Mixed-Integer Linear Optimization via Learning-Based Two-Layer Large Neighborhood Search

A Machine Learning Approach to Two-Stage Adaptive Robust Optimization