Abstract:This paper concerns the characterization of a lower semicontinuous value function in terms of the unique generalized solution of the Hamilton Jacobi equation (HJE), for optimal control problems with end point and pathwise state constraints. There is an extensive literature on this topic, in the contexts both of finite and infinite horizon problems. A key step in establishing this link is to validate a certain 'interiority' property, specifically to show that an arbitrary state trajectory satisfying the state constraint can be approximated by an interior state trajectory. The step has traditionally been accomplished under the hypothesis that, at each point in the boundary of the state constraint set, there exist admissible velocities strictly pointing away from the boundary of the state constraint set. This is a significant restriction, since this 'strict sense' outward/inward pointing condition is violated by control of systems, typically encountered in mechanical control, where the control action affects the rate of change of the state, not directly, but through the intermediary of a dynamic system. A class of control systems has been recently identified that enjoy this interiority property, but for which the strict sense outward pointing condition is violated. These advances have been used to establish uniqueness of continuous viscosity solutions of the relevant Hamilton Jacobi equation for an infinite horizon formulation of the problem involving such systems. In this paper, we exploit this newly discovered property also to provide the desired characterization of the value function for finite horizon problems involving endpoint and pathwise state constraints, when the value function is possibly discontinuous and the traditional strict outward pointing condition is replaced by a softer, second order condition.

Value function for nonautonomous problems in the Calculus of Variations

Avoidance of the Lavrentiev gap for one-dimensional non-autonomous functionals with constraints

A unified approach to the calculus of variations on time scales

Unbounded Hamilton-Jacobi-Bellman Equations with one co-dimensional discontinuities

Existence, uniqueness and characterisation of local minimisers in higher order Calculus of Variations in $\mathrm L^{\infty}$

Discontinuous solutions to the hamilton jacobi equation under second order interiority hypotheses

Differentiability of the value function on of semilinear parabolic infinite time horizon optimal control problems under control constraints

On non-locality in the Calculus of Variations

Direct and Inverse Variational Problems on Time Scales: A Survey

A Class Of Homogenization Problems In The Calculus Of Variations

Calculus of Variation and Path-Integrals with Non-Linear Generalized Functions

Subgradient evolution of value functions in discrete-time optimal control

The Lavrentiev phenomenon

Viability for locally monotone evolution inclusions and lower semicontinuous solutions of Hamilton-Jacobi-Bellman equations in infinite dimensions

Geometric Constrained Variational Calculus. I. - Piecewise smooth extremals

The value function of an asymptotic exit-time optimal control problem

Euler–Lagrange equation for gradient-type Lagrangian and related conservation laws

A necessary condition for extremality of solutions to autonomous obstacle problems with general growth

Discrete approximations and optimality conditions for integro-differential inclusions

Variational inequalities and smooth-fit principle for singular stochastic control problems in Hilbert spaces

Change of variable formulas for non-anticipative functionals on path space