A Variational Inequality Approach to Optimal Control Problems with Joint Constraints.

Zhengyu Wang, Stefan Pickl

DOI: https://doi.org/10.1007/978-3-030-18500-8_63

2018-01-01

Abstract:We reformulate the optimal control problem (OCP) with joint state-control constraint into a variational inequality (VI), we use this reformulation to establish the solvability of the OCP, and propose a regularized Galerkin method, convergence properties are presented.

What problem does this paper attempt to address?

An Improved Smoothing Technique-Based Control Vector Parameterization Method for Optimal Control Problems with Inequality Path Constraints

Ping Liu,Xiangyu Li,Xinggao Liu,Yunqing Hu

DOI: https://doi.org/10.1002/oca.2273

2016-01-01

Optimal Control Applications and Methods

Abstract:An improved control vector parameterization (CVP) method is proposed to solve optimal control problems with inequality path constraints by introducing the l(1) exact penalty function and a novel smoothing technique. Both the state and control variables are allowed to appear explicitly in the inequality path constraints simultaneously. By applying the penalty function and smoothing technique, all the inequality path constraints are firstly reformulated as non-differentiable penalty terms and incorporated into the objective function. Then, the penalty terms are smoothed by using a novel smooth function, leading to a smooth optimal control problem with no inequality path constraints. With discretizing the control space, a corresponding nonlinear programming (NLP) problem is derived, and error between the NLP problem and the original problem is discussed. Results reveal that if the smoothing parameter is sufficiently small, the solution of the NLP problem is approximately equal to the original problem, which shows the convergence of the proposed method. After clarifying some theories of the proposed approach, a concomitant numerical algorithm is put forward with furnishing the updating rules of both the penalty parameter and smoothing parameter. Simulation examples verify the advantages of the proposed method for tackling nonlinear optimal control problems with different inequality path constraints. Copyright (c) 2016 John Wiley & Sons, Ltd.
Optimal Control of a New Class of Parabolic Quasi Variational–Hemivariational Inequality

Zhao Jing,Ze Yuan,Zhenhai Liu,Stanislaw Migórski

DOI: https://doi.org/10.1007/s00245-024-10190-x

2024-10-15

Applied Mathematics & Optimization

Abstract:The primary objective of this paper is to study a new class of parabolic quasi variational–hemivariational inequalities. First, we prove a unique solvability result for such class under some mild conditions. Second, we show the existence of an optimal solution for an associated control problem. Finally, these results are applied to a model of quasistatic frictional contact in mechanics.

mathematics, applied
A Novel Penalty Approach for Nonlinear Dynamic Optimization Problems with Inequality Path Constraints

Xinggao Liu,Yunqing Hu,Jianghua Feng,Kean Liu

DOI: https://doi.org/10.1109/tac.2014.2317293

IF: 6.549

2014-01-01

IEEE Transactions on Automatic Control

Abstract:The control vector parameterization (CVP) approach is popular to solve nonlinear dynamic optimization problems, but handling inequality path constraints within its framework is a challenge. This study deals with inequality path constraints by using the l(1) penalty function and a novel smoothing technique. After clarifying some theories of the proposed approach, a concomitant algorithm is also put forward and verified.
An Optimal Control Problem Governed by Quasi-Linear Variational Inequalities

Hongwei Lou

DOI: https://doi.org/10.1137/S0363012900375032

IF: 2.2

2006-01-01

SIAM Journal on Control and Optimization

Abstract:An optimal control problem governed by quasi-linear variational inequality is considered. The cost functional to be minimized contains the solution of a quasi-linear variational inequality. To get the existence, regularity, and necessary condition for the optimal pair, a new related control problem is introduced. By proving the existence of an optimal pair to such a new problem, the existence and regularity of the optimal pair to the original problem are obtained. It turns out that the regularity obtained is sharp in general. Some necessary conditions of the optimal pair are also obtained.
Existence of Optimal Sets for Linear Variational Equations and Inequalities

V. G. Zamuraev

DOI: https://doi.org/10.1134/s0012266124060053

2024-09-21

Differential Equations

Abstract:The paper considers an optimal control problem in which the plant is described by a linear functional equation in a Hilbert space and a control action is a change of the space. Sufficient conditions for the existence of a solution are obtained. The results are generalized to the case in which the plant is described by a linear variational inequality.

mathematics
Optimal control of differential quasivariational-hemivariational inequalities with applications

Dong-ling Cai,Stanisław Migórski,Yi-bin Xiao

DOI: https://doi.org/10.1007/s11425-022-2180-7

2024-08-31

Science China Mathematics

Abstract:In this paper, we study a new class of differential quasivariational-hemivariational inequalities of the elliptic type. The problem consists of a system coupling the Cauchy problem for an ordinary differential equation with the variational-hemivariational inequalities, unilateral constraints, and history-dependent operators. First, based on the Minty formulation and the continuity of the solution map of a parametrized quasivariational-hemivariational inequality, and a fixed point theorem for a history-dependent operator, we prove a result on the well-posedness. Next, we examine optimal control problems for differential quasivariational-hemivariational inequalities, including a time-optimal control problem and a maximum stay control problem, for which we show the existence of solutions. In all the optimal control problems, the system is controlled through a distributed and boundary control, a control in initial conditions, and a control that appears in history-dependent operators. Finally, we illustrate the results by considering a nonlinear controlled system for a time-dependent elliptic equation with unilateral constraints.

mathematics, applied
Solve the General Constrained Optimal Control Problem with Common Integration Method

Sheng Zhang,Jin-Mei Gao

DOI: https://doi.org/10.48550/arXiv.1802.02140

2018-02-06

Systems and Control

Abstract:Computation of general state- and/or control-constrained Optimal Control Problems (OCPs) is difficult for various constraints, especially the intractable path constraint. For such problems, the theoretical convergence of numerical algorithms is usually not guaranteed, and the right solution may not be successfully obtained. With the recently proposed Variation Evolving Method (VEM), the evolution equations, which guarantee the convergence towards the optimal solution in theory even for the general constrained OCPs, are derived. In particular, the costate-free optimality conditions are established. Besides the analytic expressions of the costates and the Lagrange multipliers adjoining the terminal constraint, the integral equation that determines the Karush-Kuhn-Tucker (KKT) multiplier variable is also derived. Upon the work in this paper, the general constrained OCPs may be transformed to the Initial-value Problems (IVPs) to be solved, with common Ordinary Differential Equation (ODE) numerical integration methods.
Stochastic Linear-quadratic Control Problems with Affine Constraints

Zhun Gou,Nan-jing Huang,Xian-jun Long,Jian-hao Kang

2024-04-16

Abstract:This paper investigates the stochastic linear-quadratic control problems with affine constraints, in which both equality and inequality constraints are involved. With the help of the Pontryagin maximum principle and Lagrangian duality theory, the dual problem of original problem is established and the state feedback form of the solution to the optimal control problem is obtained. Under the Slater condition, the equivalence is proved between the solutions to the original problem and the ones of the dual problem, and the KKT condition is also provided for solving original problem. Especially, a new sufficient condition is given for the invertibility assumption, which ensures the uniqueness of the solutions to the dual problem.

Optimization and Control
Coefficient Control of Variational Inequalities

Andreas Hehl,Denis Khimin,Ira Neitzel,Nicolai Simon,Thomas Wick,Winnifried Wollner

2023-07-03

Abstract:Within this chapter, we discuss control in the coefficients of an obstacle problem. Utilizing tools from H-convergence, we show existence of optimal solutions. First order necessary optimality conditions are obtained after deriving directional differentiability of the coefficient to solution mapping for the obstacle problem. Further, considering a regularized obstacle problem as a constraint yields a limiting optimality system after proving, strong, convergence of the regularized control and state variables. Numerical examples underline convergence with respect to the regularization. Finally, some numerical experiments highlight the possible extension of the results to coefficient control in phase-field fracture.

Optimization and Control
Algorithm for Variational Inequality Problems Based on a Gradient Dynamical System Designed Using a Control Liapunov Function

Fernando Agustin Pazos,Amit Bhaya

DOI: https://doi.org/10.1109/isic.2007.4450953

2007-01-01

Abstract:We present an algorithm to find the optimal point of a variational inequality problem. The domain of the function that defines the variational inequality is a convex set, determined by convex inequality constraints and affine equality constraints. The algorithm is based on a discrete variable structure closed-loop control system which presents sliding mode trajectories on the boundary of the feasible set until the optimal point is reached. The update law is designed using control Liapunov function (CLF), which guarantees the decrease of a discrete Liapunov function inside and outside the feasible set. The step size is optimized using Liapunov optimizing control (LOC).
Stochastic linear–quadratic control problems with affine constraints

Zhun Gou,Nan-Jing Huang,Xian-Jun Long,Jian-Hao Kang

DOI: https://doi.org/10.1016/j.sysconle.2024.105887

IF: 2.742

2024-07-29

Systems & Control Letters

Abstract:This paper investigates the stochastic linear–quadratic control problems with affine constraints, in which both equality and inequality constraints are involved. With the help of the Pontryagin maximum principle and Lagrangian duality theory, both the dual problem and the state feedback form of the solution are obtained for the primal problem. Under the Slater condition, the strong duality is proved between the dual problem and the primal problem, and the KKT condition is also provided for solving the primal problem. Moreover, a new sufficient condition is given for the invertibility assumption, which ensures the uniqueness of the solutions to the dual problem. Finally, two numerical examples are provided to illustrate our main results.

automation & control systems,operations research & management science
First-order methods for Stochastic Variational Inequality problems with Function Constraints

Digvijay Boob,Qi Deng,Mohammad Khalafi

2024-05-25

Abstract:The monotone Variational Inequality (VI) is a general model with important applications in various engineering and scientific domains. In numerous instances, the VI problems are accompanied by function constraints that can be data-driven, making the usual projection operator challenging to compute. This paper presents novel first-order methods for the function-constrained Variational Inequality (FCVI) problem in smooth or nonsmooth settings with possibly stochastic operators and constraints. We introduce the AdOpEx method, which employs an operator extrapolation on the KKT operator of the FCVI in a smooth deterministic setting. Since this operator is not uniformly Lipschitz continuous in the Lagrange multipliers, we employ an adaptive two-timescale algorithm leading to bounded multipliers and achieving the optimal $O(1/T)$ convergence rate. For the nonsmooth and stochastic VIs, we introduce design changes to the AdOpEx method and propose a novel P-OpEx method that takes partial extrapolation. It converges at the rate of $O(1/\sqrt{T})$ when both the operator and constraints are stochastic or nonsmooth. This method has suboptimal dependence on the noise and Lipschitz constants of function constraints. We propose a constraint extrapolation approach leading to the OpConEx method that improves this dependence by an order of magnitude. All our algorithms easily extend to saddle point problems with function constraints that couple the primal and dual variables while maintaining the same complexity results. To the best of our knowledge, all our complexity results are new in the literature

Optimization and Control,Machine Learning
Discrete Variational Optimal Control

Fernando Jimenez,Marin Kobilarov,David Martin de Diego

DOI: https://doi.org/10.1007/s00332-012-9156-z

2012-03-03

Abstract:This paper develops numerical methods for optimal control of mechanical systems in the Lagrangian setting. It extends the theory of discrete mechanics to enable the solutions of optimal control problems through the discretization of variational principles. The key point is to solve the optimal control problem as a variational integrator of a specially constructed higher-dimensional system. The developed framework applies to systems on tangent bundles, Lie groups, underactuated and nonholonomic systems with symmetries, and can approximate either smooth or discontinuous control inputs. The resulting methods inherit the preservation properties of variational integrators and result in numerically robust and easily implementable algorithms. Several theoretical and a practical examples, e.g. the control of an underwater vehicle, will illustrate the application of the proposed approach.

Optimization and Control
Solving Constrained Variational Inequalities via a First-order Interior Point-based Method

Tong Yang,Michael I. Jordan,Tatjana Chavdarova

DOI: https://doi.org/10.48550/arXiv.2206.10575

IF: 5.414

2022-06-21

Machine Learning

Abstract:We develop an interior-point approach to solve constrained variational inequality (cVI) problems. Inspired by the efficacy of the alternating direction method of multipliers (ADMM) method in the single-objective context, we generalize ADMM to derive a first-order method for cVIs, that we refer to as ADMM-based interior-point method for constrained VIs (ACVI). We provide convergence guarantees for ACVI in two general classes of problems: (i) when the operator is $\xi$-monotone, and (ii) when it is monotone, some constraints are active and the game is not purely rotational. When the operator is, in addition, L-Lipschitz for the latter case, we match known lower bounds on rates for the gap function of $\mathcal{O}(1/\sqrt{K})$ and $\mathcal{O}(1/K)$ for the last and average iterate, respectively. To the best of our knowledge, this is the first presentation of a first-order interior-point method for the general cVI problem that has a global convergence guarantee. Moreover, unlike previous work in this setting, ACVI provides a means to solve cVIs when the constraints are nontrivial. Empirical analyses demonstrate clear advantages of ACVI over common first-order methods. In particular, (i) cyclical behavior is notably reduced as our methods approach the solution from the analytic center, and (ii) unlike projection-based methods that zigzag when near a constraint, ACVI efficiently handles the constraints.
Some Insights on Synthesizing Optimal Linear Quadratic Controller Using Krotov's Sufficiency Conditions

Avinash Kumar,Tushar Jain

DOI: https://doi.org/10.48550/arXiv.1807.02631

2019-03-29

Abstract:This paper revisits the problem of optimal control law design for linear systems using the global optimal control framework introduced by Vadim Krotov. Krotov's approach is based on the idea of total decomposition of the original optimal control problem (OCP) with respect to time, by an $ad$ $hoc$ choice of the so-called Krotov's function or solving function, thereby providing sufficient conditions for the existence of global solution based on another optimization problem, which is completely equivalent to the original OCP. It is well known that the solution of this equivalent optimization problem is obtained using an iterative method. In this paper, we propose suitable Krotov's functions for linear quadratic OCP and subsequently, show that by imposing convexity condition on this equivalent optimization problem, there is no need to compute an iterative solution. We also give some key insights into the solution procedure of the linear quadratic OCP using the proposed methodology in contrast to the celebrated Calculus of Variations (CoV) and Hamilton-Jacobi-Bellman (HJB) equation based approach.

Optimization and Control,Systems and Control
Joint Chance Constrained Optimal Control via Linear Programming

Niklas Schmid,Marta Fochesato,Tobias Sutter,John Lygeros

2024-05-18

Abstract:We establish a linear programming formulation for the solution of joint chance constrained optimal control problems over finite time horizons. The joint chance constraint may represent an invariance, reachability or reach-avoid specification that the trajectory must satisfy with a predefined probability. For finite state and action spaces, the solution is exact and our method computationally superior to approaches in the literature. For continuous state or action spaces, our linear programming formulation enables basis function approximations.

Optimization and Control,Systems and Control
A Primal-Dual Approach to Solving Variational Inequalities with General Constraints

Tatjana Chavdarova,Tong Yang,Matteo Pagliardini,Michael I. Jordan

2024-08-04

Abstract:Yang et al. (2023) recently showed how to use first-order gradient methods to solve general variational inequalities (VIs) under a limiting assumption that analytic solutions of specific subproblems are available. In this paper, we circumvent this assumption via a warm-starting technique where we solve subproblems approximately and initialize variables with the approximate solution found at the previous iteration. We prove the convergence of this method and show that the gap function of the last iterate of the method decreases at a rate of $O(\frac{1}{\sqrt{K}})$ when the operator is $L$-Lipschitz and monotone. In numerical experiments, we show that this technique can converge much faster than its exact counterpart. Furthermore, for the cases when the inequality constraints are simple, we introduce an alternative variant of ACVI and establish its convergence under the same conditions. Finally, we relax the smoothness assumptions in Yang et al., yielding, to our knowledge, the first convergence result for VIs with general constraints that does not rely on the assumption that the operator is $L$-Lipschitz.

Machine Learning
Optimal Control of a Quasi-Variational Sweeping Process

Harbir Antil,Rafael Arndt,Boris S. Mordukhovich,Dao Nguyen,Carlos N. Rautenberg

DOI: https://doi.org/10.48550/arXiv.2209.00075

2022-09-01

Abstract:The paper addresses the study of a class of evolutionary quasi-variational inequalities of the parabolic type arising in the formation and growth models of granular and cohensionless materials. Such models and their mathematical descriptions are highly challenging and require powerful tools of their analysis and implementation. We formulate a space-time continuous optimal control problem for a basic model of this type, develop several regularization and approximation procedures, and establish the existence of optimal solutions for the time-continuous and space-discrete problem. Viewing a version of this problem as a controlled quasi-variational sweeping process leads us to deriving necessary optimality conditions for the fully discrete problem by using the advanced machinery of variational analysis and generalized differentiation.

Optimization and Control
Computation of Optimal Control Problems with Terminal Constraint via Variation Evolution

Sheng Zhang,Bo Liao,Fei Liao

DOI: https://doi.org/10.48550/arXiv.1801.01383

2018-01-02

Systems and Control

Abstract:Enlightened from the inverse consideration of the stable continuous-time dynamics evolution, the Variation Evolving Method (VEM) analogizes the optimal solution to the equilibrium point of an infinite-dimensional dynamic system and solves it in an asymptotically evolving way. In this paper, the compact version of the VEM is further developed for the computation of Optimal Control Problems (OCPs) with terminal constraint. The corresponding Evolution Partial Differential Equation (EPDE), which describes the variation motion towards the optimal solution, is derived, and the costate-free optimality conditions are established. The explicit analytic expressions of the costates and the Lagrange multipliers adjoining the terminal constraint, related to the states and the control variables, are presented. With the semi-discrete method in the field of PDE numerical calculation, the EPDE is discretized as finite-dimensional Initial-value Problems (IVPs) to be solved, with common Ordinary Differential Equation (ODE) numerical integration methods.
Second-order sufficient conditions in optimal control of evolution systems

H. Frankowska,E. M. Marchini,M. Mazzola

DOI: https://doi.org/10.1007/s00028-024-00968-5

2024-04-29

Journal of Evolution Equations

Abstract:This paper concerns second-order sufficient conditions of optimality for a class of infinite dimensional optimal control problems under control constraints and end-point constraints. The distinctive feature of our formulation is the use of variational analysis techniques. Our approach is based on a suitable decomposition of controls, using second-order tangents, and it is developed in the case of functional constraints. An adaptation of the tools in the case of pointwise constraints on the controls is proposed too. We provide applications to concrete optimal control problems involving PDEs.

mathematics, applied

A Variational Inequality Approach to Optimal Control Problems with Joint Constraints.

An Improved Smoothing Technique-Based Control Vector Parameterization Method for Optimal Control Problems with Inequality Path Constraints

Optimal Control of a New Class of Parabolic Quasi Variational–Hemivariational Inequality

A Novel Penalty Approach for Nonlinear Dynamic Optimization Problems with Inequality Path Constraints

An Optimal Control Problem Governed by Quasi-Linear Variational Inequalities

Existence of Optimal Sets for Linear Variational Equations and Inequalities

Optimal control of differential quasivariational-hemivariational inequalities with applications

Solve the General Constrained Optimal Control Problem with Common Integration Method

Stochastic Linear-quadratic Control Problems with Affine Constraints

Coefficient Control of Variational Inequalities

Algorithm for Variational Inequality Problems Based on a Gradient Dynamical System Designed Using a Control Liapunov Function

Stochastic linear–quadratic control problems with affine constraints

First-order methods for Stochastic Variational Inequality problems with Function Constraints

Discrete Variational Optimal Control

Solving Constrained Variational Inequalities via a First-order Interior Point-based Method

Some Insights on Synthesizing Optimal Linear Quadratic Controller Using Krotov's Sufficiency Conditions

Joint Chance Constrained Optimal Control via Linear Programming

A Primal-Dual Approach to Solving Variational Inequalities with General Constraints

Optimal Control of a Quasi-Variational Sweeping Process

Computation of Optimal Control Problems with Terminal Constraint via Variation Evolution

Second-order sufficient conditions in optimal control of evolution systems