Abstract:This paper concerns the characterization of a lower semicontinuous value function in terms of the unique generalized solution of the Hamilton Jacobi equation (HJE), for optimal control problems with end point and pathwise state constraints. There is an extensive literature on this topic, in the contexts both of finite and infinite horizon problems. A key step in establishing this link is to validate a certain 'interiority' property, specifically to show that an arbitrary state trajectory satisfying the state constraint can be approximated by an interior state trajectory. The step has traditionally been accomplished under the hypothesis that, at each point in the boundary of the state constraint set, there exist admissible velocities strictly pointing away from the boundary of the state constraint set. This is a significant restriction, since this 'strict sense' outward/inward pointing condition is violated by control of systems, typically encountered in mechanical control, where the control action affects the rate of change of the state, not directly, but through the intermediary of a dynamic system. A class of control systems has been recently identified that enjoy this interiority property, but for which the strict sense outward pointing condition is violated. These advances have been used to establish uniqueness of continuous viscosity solutions of the relevant Hamilton Jacobi equation for an infinite horizon formulation of the problem involving such systems. In this paper, we exploit this newly discovered property also to provide the desired characterization of the value function for finite horizon problems involving endpoint and pathwise state constraints, when the value function is possibly discontinuous and the traditional strict outward pointing condition is replaced by a softer, second order condition.

Hamilton-Jacobi equations for optimal control on networks with entry or exit costs

Hamilton-Jacobi equations for optimal control on multidimensional junctions

Unbounded Hamilton-Jacobi-Bellman Equations with one co-dimensional discontinuities

Bounded-From-Below Solutions of the Hamilton-Jacobi Equation for Optimal Control Problems with Exit Times: Vanishing Lagrangians, Eikonal Equations, and Shape-From-Shading

Nonlocal Hamilton-Jacobi Equations on a network with Kirchhoff type conditions

Non-local Hamilton-Jacobi-Bellman equations for the stochastic optimal control of path-dependent piecewise deterministic processes

Time--dependent equations on networks

Inverse optimal stabilization of cooperative control in networked multi-agent systems

Optimal control on finite graphs: asymptotic optimal controls and ergodic constant in the case of entropic costs

Optimal Control of Linear Cost Networks

Port-Hamiltonian structures in infinite-dimensional optimal control: Primal-Dual gradient method and control-by-interconnection

Discontinuous solutions to the hamilton jacobi equation under second order interiority hypotheses

Effective transmission conditions for Hamilton-Jacobi equations defined on two domains separated by an oscillatory interface

Hidden regularity in singular optimal control of port-Hamiltonian systems

Linear-quadratic optimal control for infinite-dimensional input-state-output systems

Controlling network ensembles

Optimal control of nonlocal continuity equations: numerical solution

Existence of viscosity solutions for Hamilton-Jacobi equations on Riemannian Manifolds via Lyapunov control

An optimal boundary control problem related to the time dependent Navier-Stokes equations

Optimal movement control models of Langevin and Hamiltonian types

Time-Inconsistent Stochastic Optimal Control Problems and Backward Stochastic Volterra Integral Equations