Abstract:We propose a method to approximate the solution of online mixed-integer optimization (MIO) problems at very high speed using machine learning. By exploiting the repetitive nature of online optimization, we can greatly speed up the solution time. Our approach encodes the optimal solution into a small amount of information denoted as strategy using the voice of optimization framework. In this way, the core part of the optimization routine becomes a multiclass classification problem that can be solved very quickly. In this work, we extend that framework to real-time and high-speed applications focusing on parametric mixed-integer quadratic optimization. We propose an extremely fast online optimization method consisting of a feedforward neural network evaluation and a linear system solution where the matrix has already been factorized. Therefore, this online approach does not require any solver or iterative algorithm. We show the speed of the proposed method both in terms of total computations required and measured execution time. We estimate the number of floating point operations required to completely recover the optimal solution as a function of the problem dimensions. Compared with state-of-the-art MIO routines, the online running time of our method is very predictable and can be lower than a single matrix factorization time. We benchmark our method against the state-of-the-art solver Gurobi obtaining up to two to three orders of magnitude speedups on examples from fuel cell energy management, sparse portfolio optimization, and motion planning with obstacle avoidance. Summary of Contribution: We propose a technique to approximate the solution of online optimization problems at high speed using machine learning. By exploiting the repetitive nature of online optimization, we learn the mapping between the key problem parameters and an encoding of the optimal solution to greatly speed up the solution time. This allows us to significantly improve the computation time and resources needed to solve online mixed-integer optimization problems. We obtain a simple method with a very low computing time variance, which is crucial in online settings.

Automatic discovery of optimal meta-solvers via multi-objective optimization

Automatic Algorithm Selection for Pseudo-Boolean Optimization with Given Computational Time Limits

AutoOpt: A General Framework for Automatically Designing Metaheuristic Optimization Algorithms with Diverse Structures

Meta-learning for Multi-variable Non-convex Optimization Problems: Iterating Non-optimums Makes Optimum Possible

A Hybridized Vector Optimal Algorithm for Multiobjective Designs of Inverse Problems

Neural Solver Selection for Combinatorial Optimization

Online Mixed-Integer Optimization in Milliseconds

Solving Multi-Objective Optimal Control Problems Using a Multiresolution Approach

Multiobjective Optimization of Non-Smooth PDE-Constrained Problems

AI‐enhanced iterative solvers for accelerating the solution of large‐scale parametrized systems

A learning-based mathematical programming formulation for the automatic configuration of optimization solvers

Self-Supervised Learning of Iterative Solvers for Constrained Optimization

Teaching Networks to Solve Optimization Problems

Learning to Optimize Multigrid PDE Solvers

Meta-Auto-Decoder for Solving Parametric Partial Differential Equations

Learning Multiple Initial Solutions to Optimization Problems

A Swarm Exploring Neural Dynamics Method for Solving Convex Multi-Objective Optimization Problem

SOLVERS FOR SYSTEMS OF LARGE SPARSE LINEAR AND NONLINEAR EQUATIONS BASED ON MULTI-GPUS

Efficient Meta Neural Heuristic for Multi-Objective Combinatorial Optimization

Parallelized multiobjective efficient global optimization algorithm and its applications

Efficient Multi-Objective Simulation Metamodeling for Researchers