Abstract:Constrained optimization problems appear in a wide variety of challenging real-world problems, where constraints often capture the physics of the underlying system. Classic methods for solving these problems rely on iterative algorithms that explore the feasible domain in the search for the best solution. These iterative methods are often the computational bottleneck in decision-making and adversely impact time-sensitive applications. Recently, neural approximators have shown promise as a replacement for the iterative solvers that can output the optimal solution in a single feed-forward providing rapid solutions to optimization problems. However, enforcing constraints through neural networks remains an open challenge. This paper develops a neural approximator that maps the inputs to an optimization problem with hard linear constraints to a feasible solution that is nearly optimal. Our proposed approach consists of four main steps: 1) reducing the original problem to optimization on a set of independent variables, 2) finding a gauge function that maps the infty-norm unit ball to the feasible set of the reduced problem, 3)learning a neural approximator that maps the optimization's inputs to an optimal point in the infty-norm unit ball, and 4) find the values of the dependent variables from the independent variable and recover the solution to the original problem. We can guarantee hard feasibility through this sequence of steps. Unlike the current learning-assisted solutions, our method is free of parameter-tuning and removes iterations altogether. We demonstrate the performance of our proposed method in quadratic programming in the context of the optimal power dispatch (critical to the resiliency of our electric grid) and a constrained non-convex optimization in the context of image registration problems.

An Analysis of a Neural Dynamical Approach to Solving Optimization Problems

Neural Network Solution for General Nonlinear Optimization Problems

A novel neural dynamical approach to convex quadratic program and its efficient applications.

A discrete-time neural network for optimization problems with hybrid constraints.

Convergence analysis of discrete time recurrent neural networks for linear variational inequality problem

Neural networks for nonconvex nonlinear programming problems: a switching control approach

A New Neural Network for Solving a Class of Linear Variation Inequalities

A Novel Neural Network for Variational Inequalities with Linear and Nonlinear Constraints

A Neural Network for Solving Nonlinear Programming Problems.

A Neurodynamic Approach to Nonsmooth Constrained Pseudoconvex Optimization Problem

A neurodynamic approach to nonlinear optimization problems with affine equality and convex inequality constraints.

Differential inclusions-based neural networks for nonsmooth convex optimization on a closed convex subset

Stability and Convergence Analysis for a Class of Neural Networks

Learning to Solve Optimization Problems with Hard Linear Constraints

A neural network with finite-time convergence for a class of variational inequalities

A neural network for monotone variational inequalities with linear constraints

A Neurodynamic Approach for a Class of Convex-concave Minimax Problems

Distributed Neurodynamic Approaches to Nonsmooth Optimization Problems with Inequality and Set Constraints

Notes on a Neural Network Approach to Inverse Variational Inequalities

Neural Network for Solving Constrained Convex Optimization Problems with Global Attractivity

Neurodynamic Optimization Approaches with Finite/fixed-Time Convergence for Absolute Value Equations.