Abstract:Mixed-Integer Linear Programming (MILP) is an optimization technique widely used in various fields. Primal heuristics, which reduce the search space of MILP, have enabled traditional solvers (e.g., Gurobi) to efficiently find high-quality solutions. However, traditional primal heuristics rely on expert knowledge, motivating the advent of machine learning (ML)-based primal heuristics that learn repetitive patterns in MILP. Nonetheless, existing ML-based primal heuristics do not guarantee solution feasibility (i.e., satisfying all constraints) and primarily focus on prediction for binary decision variables. When addressing MILP involving non-binary integer variables using ML-based approaches, feasibility issues can become even more pronounced. Since finding an optimal solution requires satisfying all constraints, addressing feasibility is critical. To overcome these limitations, we propose a novel reinforcement learning (RL)-based solver that interacts with MILP to find feasible solutions, rather than delegating sub-problems to traditional solvers. We design reward functions tailored for MILP, which enables the RL agent to learn relationships between decision variables and constraints. Additionally, to effectively model complex relationships among decision variables, we leverage a Transformer encoder-based graph neural network (GNN). Our experimental results demonstrate that the proposed method can solve MILP problems and find near-optimal solutions without delegating the remainder to traditional solvers. The proposed method provides a meaningful step forward as an initial study in solving MILP problems end-to-end based solely on ML.

Optimal pivot path of the simplex method for linear programming based on reinforcement learning

On the optimal pivot path of simplex method for linear programming based on reinforcement learning

Learning to Pivot as a Smart Expert

Exponential Lower Bounds for Many Pivot Rules for the Simplex Method

A unified worst case for classical simplex and policy iteration pivot rules

On the Simplex Method for 0/1-Polytopes

Reinforcement Learning for Node Selection in Mixed Integer Programming

Reinforcement Learning for Branch-and-Bound Optimisation using Retrospective Trajectories

A Monotonic Build-Up Simplex Algorithm for Linear Programming

Learn to relax: Integrating 0-1 integer linear programming with pseudo-Boolean conflict-driven search

Exponential lower bounds for history-based simplex pivot rules on abstract cubes

Sparsity Prevention Pivoting Method for Linear Programming.

A double-pivot simplex algorithm and its upper bounds of the iteration numbers

One-shot Learning for MIPs with SOS1 Constraints

Monte Carlo Tree Search for Policy Optimization.

Learning to Branch in Mixed Integer Programming

RL-MILP Solver: A Reinforcement Learning Approach for Solving Mixed-Integer Linear Programs with Graph Neural Networks

A novel reinforcement learning-based method for structure optimization

Beyond Trial and Error: Lane Keeping with Monte Carlo Tree Search-Driven Optimization of Reinforcement Learning

A quadratic simplex algorithm for primal optimization over zero-one polytopes

Integer Programming as a General Solution Methodology for Path-Based Optimization in Robotics: Principles, Best Practices, and Applications