Abstract:In this paper, we address the challenge of solving large-scale graph-structured nonlinear programs (gsNLPs) in a scalable manner. GsNLPs are problems in which the objective and constraint functions are associated with nodes on a graph and depend on the variables of adjacent nodes. This graph-structured formulation encompasses various specific instances, such as dynamic optimization, PDE-constrained optimization, multistage stochastic optimization, and general network optimization. By leveraging the sequential quadratic programming (SQP) framework, we propose a globally convergent overlapping graph decomposition method to solve large-scale gsNLPs under standard mild regularity conditions on the graph topology. In each iteration, we perform an overlapping graph decomposition to compute an approximate Newton direction in a parallel environment. Then, we select a suitable stepsize and update the primal-dual iterate by performing a backtracking line search on an exact augmented Lagrangian merit function. Built on the exponential decay of sensitivity of gsNLPs, we show that the approximate Newton direction is a descent direction of the augmented Lagrangian, which leads to global convergence with a local linear convergence rate. In particular, global convergence is achieved for sufficiently large overlaps, and the local linear convergence rate improves exponentially in terms of the overlap size. Our results match existing state-of-the-art guarantees established for dynamic programs (which simply correspond to linear graphs). We validate the theory on a semilinear elliptic PDE-constrained problem.

A delayed lagrangian network for solving quadratic programming problems with equality constraints

Neural Network Solution for General Nonlinear Optimization Problems

A discrete-time neural network for optimization problems with hybrid constraints.

Stability analysis of delayed neural networks based on improved quadratic function condition

Solving for a Quadratic Programming with a Quadratic Constraint Based on a Neural Network Frame

Delay Reduction Via Lagrange Multipliers in Stochastic Network Optimization

Lagrangian dual method for solving stochastic linear quadratic optimal control problems with terminal state constraints

A new recurrent neural network for solving convex quadratic programming problems with an application to the κ-winners-take-all problem

Global Exponential Stability of Discrete-Time Neural Networks for Constrained Quadratic Optimization

Inequality constrained stochastic nonlinear optimization via active-set sequential quadratic programming

Stochastic Optimal Linear Quadratic Regulation Control of Discrete-time Systems with Delay and Quadratic Constraints

A New Algorithm for Finding Global Solution of Indefinite Quadratic Programming Problems

Distributed Sequential Quadratic Programming with Overlapping Graph Decomposition and Exact Augmented Lagrangian

An Improved Dual Neural Network for Solving A Class of Quadratic Programming Problems and Its K-Winners-Take-All Application

Another simple recurrent neural network for quadratic and linear programming

A Gradient-Based Neural Network Method for Solving Strictly Convex Quadratic Programming Problems

Convergence of a Recurrent Neural Network for Nonconvex Optimization Based on an Augmented Lagrangian Function

An Improved Sequential Quadratic Programming Algorithm for Solving General Nonlinear Programming Problems

A Novel Neural Network for Nonlinear Convex Programming

Duality Gap Estimation Of Linear Equality Constrained Binary Quadratic Programming

Quadratic Programming Problems and Its Solution Techniques With Neural Network Modeling