A Penalty-Based Guardrail Algorithm for Non-Decreasing Optimization with Inequality Constraints

Ksenija Stepanovic,Wendelin Böhmer,Mathijs de Weerdt

2024-05-03

Abstract:Traditional mathematical programming solvers require long computational times to solve constrained minimization problems of complex and large-scale physical systems. Therefore, these problems are often transformed into unconstrained ones, and solved with computationally efficient optimization approaches based on first-order information, such as the gradient descent method. However, for unconstrained problems, balancing the minimization of the objective function with the reduction of constraint violations is challenging. We consider the class of time-dependent minimization problems with increasing (possibly) nonlinear and non-convex objective function and non-decreasing (possibly) nonlinear and non-convex inequality constraints. To efficiently solve them, we propose a penalty-based guardrail algorithm (PGA). This algorithm adapts a standard penalty-based method by dynamically updating the right-hand side of the constraints with a guardrail variable which adds a margin to prevent violations. We evaluate PGA on two novel application domains: a simplified model of a district heating system and an optimization model derived from learned deep neural networks. Our method significantly outperforms mathematical programming solvers and the standard penalty-based method, and achieves better performance and faster convergence than a state-of-the-art algorithm (IPDD) within a specified time limit.

Optimization and Control,Artificial Intelligence

What problem does this paper attempt to address?

The problem that this paper attempts to solve is that when dealing with the optimization problems of complex and large - scale physical systems, traditional mathematical programming solvers require a long computation time. Therefore, these problems are usually transformed into unconstrained problems and solved using more computationally efficient optimization methods based on first - order information (such as the gradient - descent method). However, for unconstrained problems, it is a challenge to balance the minimization of the objective function and the reduction of constraints. In particular, for time - varying minimization problems with an increasing (possibly nonlinear and non - convex) objective function and a non - decreasing (possibly nonlinear and non - convex) inequality constraint, how to efficiently solve this type of problem is the core issue that this paper focuses on. The paper proposes a penalty - based guardrail algorithm (PGA), which effectively solves this type of problem by dynamically updating the guardrail variables on the right side of the constraint conditions to prevent constraint violations. The algorithm was evaluated in two new application areas: a simplified district heating system model and an optimization model derived from a learned deep neural network. The experimental results show that this method is significantly superior to mathematical programming solvers and standard penalty methods, and within the specified time limit, its performance and convergence speed are better than those of the state - of - the - art algorithm (IPDD).

A Penalty-Based Guardrail Algorithm for Non-Decreasing Optimization with Inequality Constraints

A Novel Penalty Approach for Nonlinear Dynamic Optimization Problems with Inequality Path Constraints

Barrier NLP Methods with Structured Regularization for Optimization of Degenerate Optimization Problems

An Improved Multi-Population Genetic Algorithm For Constrained Nonlinear Optimization

A penalty barrier framework for nonconvex constrained optimization

Structured Regularization In Barrier Nlp For Optimization Models With Dependent Constraints

Huber Loss-Based Penalty Approach to Problems with Linear Constraints

Optimizing constrained non-convex NLP problems in chemical engineering field by a novel modified goal programming genetic algorithm

A Penalty Function Algorithm with Objective Parameters for Nonlinear Mathematical Programming

A Single-Loop Gradient Descent and Perturbed Ascent Algorithm for Nonconvex Functional Constrained Optimization

NPGA: A Unified Algorithmic Framework for Decentralized Constraint-Coupled Optimization

Improving the Robustness of the Projected Gradient Descent Method for Nonlinear Constrained Optimization Problems in Topology Optimization

A Smooth Inexact Penalty Reformulation of Convex Problems with Linear Constraints

Bounding Optimality Gaps for Non-Convex Optimization Problems: Applications to Nonlinear Safety-Critical Systems

A Laplacian-Based Approach for Finding Near Globally Optimal Solutions to OPF Problems

Interior Point Method with Modified Augmented Lagrangian for Penalty-Barrier Nonlinear Programming

A Smooth Penalty Function Algorithm for Computing Nonlinear Inequality Constraint Optimization Problem

OptiGrad: A Fair and more Efficient Price Elasticity Optimization via a Gradient Based Learning

An adaptive cubic regularisation algorithm based on interior point methods for solving nonlinear inequality constrained optimization

Nonlinear Derivative-free Constrained Optimization with a Mixed Penalty-Logarithmic Barrier Approach and Direct Search

A nonsmooth exact penalty method for equality-constrained optimization: complexity and implementation