Abstract:This paper concerns the characterization of a lower semicontinuous value function in terms of the unique generalized solution of the Hamilton Jacobi equation (HJE), for optimal control problems with end point and pathwise state constraints. There is an extensive literature on this topic, in the contexts both of finite and infinite horizon problems. A key step in establishing this link is to validate a certain 'interiority' property, specifically to show that an arbitrary state trajectory satisfying the state constraint can be approximated by an interior state trajectory. The step has traditionally been accomplished under the hypothesis that, at each point in the boundary of the state constraint set, there exist admissible velocities strictly pointing away from the boundary of the state constraint set. This is a significant restriction, since this 'strict sense' outward/inward pointing condition is violated by control of systems, typically encountered in mechanical control, where the control action affects the rate of change of the state, not directly, but through the intermediary of a dynamic system. A class of control systems has been recently identified that enjoy this interiority property, but for which the strict sense outward pointing condition is violated. These advances have been used to establish uniqueness of continuous viscosity solutions of the relevant Hamilton Jacobi equation for an infinite horizon formulation of the problem involving such systems. In this paper, we exploit this newly discovered property also to provide the desired characterization of the value function for finite horizon problems involving endpoint and pathwise state constraints, when the value function is possibly discontinuous and the traditional strict outward pointing condition is replaced by a softer, second order condition.

Solving two-point boundary value problems using generating functions: Theory and Applications to optimal control and the study of Hamiltonian dynamical systems

Positive Solutions to a Singular Second Order Three-Point Boundary Value Problem

Optimal Bounded Control of First-Passage Failure of Quasi-Integrable Hamiltonian Systems with Wide-Band Random Excitation

Two-point Boundary Value Problems for Wave Equations

Infinitely Many Solutions for A Class of Fractional Hamiltonian Systems Via Critical Point Theory

Smooth transformations and ruling out closed orbits in planar systems

Positive Solutions for High-Order Boundary Value Problems with Dependence on All Derivatives

Rational Approximation for Two-Point Boundary value problems

Least-squares solutions of boundary-value problems in hybrid systems

Unbounded Hamilton-Jacobi-Bellman Equations with one co-dimensional discontinuities

Extension of Switch Point Algorithm to Boundary-Value Problems

Optimal Control of Unbounded Functional Stochastic Evolution Systems in Hilbert Spaces: Second-Order Path-dependent HJB Equation

Extended Smoothed Boundary Method for Solving Partial Differential Equations with General Boundary Conditions on Complex Boundaries

Initial-boundary value problems for discrete evolution equations: discrete linear Schrodinger and integrable discrete nonlinear Schrodinger equations

Infinitely Many Solutions for a Generalized Periodic Boundary Value Problem Without the Evenness Assumption

Discontinuous solutions to the hamilton jacobi equation under second order interiority hypotheses

Well-posed two-point initial-boundary value problems with arbitrary boundary conditions

Smoothed Boundary Method for Solving Partial Differential Equations with General Boundary Conditions on Complex Boundaries

Two-Point Boundary Problems with One Mild Singularity and an Application to Graded Kirchhoff Plates

An optimal boundary control problem related to the time dependent Navier-Stokes equations

Problem of eigenvalues of stochastic Hamiltonian systems with boundary conditions and Markov chain