Abstract:This paper concerns the characterization of a lower semicontinuous value function in terms of the unique generalized solution of the Hamilton Jacobi equation (HJE), for optimal control problems with end point and pathwise state constraints. There is an extensive literature on this topic, in the contexts both of finite and infinite horizon problems. A key step in establishing this link is to validate a certain 'interiority' property, specifically to show that an arbitrary state trajectory satisfying the state constraint can be approximated by an interior state trajectory. The step has traditionally been accomplished under the hypothesis that, at each point in the boundary of the state constraint set, there exist admissible velocities strictly pointing away from the boundary of the state constraint set. This is a significant restriction, since this 'strict sense' outward/inward pointing condition is violated by control of systems, typically encountered in mechanical control, where the control action affects the rate of change of the state, not directly, but through the intermediary of a dynamic system. A class of control systems has been recently identified that enjoy this interiority property, but for which the strict sense outward pointing condition is violated. These advances have been used to establish uniqueness of continuous viscosity solutions of the relevant Hamilton Jacobi equation for an infinite horizon formulation of the problem involving such systems. In this paper, we exploit this newly discovered property also to provide the desired characterization of the value function for finite horizon problems involving endpoint and pathwise state constraints, when the value function is possibly discontinuous and the traditional strict outward pointing condition is replaced by a softer, second order condition.

Differentiability of the value function on of semilinear parabolic infinite time horizon optimal control problems under control constraints

Exact controllability of infinite dimensional linear systems via bounded control functions

Stability in affine optimal control problems constrained by semilinear elliptic partial differential equations

Semidiscrete finite element approximation of time optimal control problems for semilinear heat equations with nonsmooth initial data.

Linear Quadratic Problem with Unbounded Control in Hilbert Spaces

Discontinuous solutions to the hamilton jacobi equation under second order interiority hypotheses

Hybrid Optimal Control Problems for a Class of Semilinear Parabolic Equations

Analysis and approximation to parabolic optimal control problems with measure-valued controls in time

Subgradient evolution of value functions in discrete-time optimal control

Stochastic optimal control in Hilbert spaces: $C^{1,1}$ regularity of the value function and optimal synthesis via viscosity solutions

Optimal Control of Semilinear Elliptic Partial Differential Equations with Non-Lipschitzian Nonlinearities

Necessary and Sufficient Conditions for Optimal Control of Semilinear Stochastic Partial Differential Equations

Optimal control of a non-smooth elliptic PDE with non-linear term acting on the control

Semi-Infinite Programs for Robust Control and Optimization: Efficient Solutions and Extensions to Existence Constraints

A unified framework for optimal control of fractional in time subdiffusive semilinear PDEs

Optimality conditions in terms of Bouligand generalized differentials for a nonsmooth semilinear elliptic optimal control problem with distributed and boundary control pointwise constraints

Existence of an Optimal Control for a Semilinear Evolution Equation with Unbounded Operator

Optimality conditions and Lipschitz stability for non-smooth semilinear elliptic optimal control problems with sparse controls

Minimal-time nonlinear control via semi-infinite programming

On the One-Dimensional Nonlinear Monodomain Equations with Moving Controls

On the continuity and smoothness of the value function in reinforcement learning and optimal control