Abstract:This paper concerns the characterization of a lower semicontinuous value function in terms of the unique generalized solution of the Hamilton Jacobi equation (HJE), for optimal control problems with end point and pathwise state constraints. There is an extensive literature on this topic, in the contexts both of finite and infinite horizon problems. A key step in establishing this link is to validate a certain 'interiority' property, specifically to show that an arbitrary state trajectory satisfying the state constraint can be approximated by an interior state trajectory. The step has traditionally been accomplished under the hypothesis that, at each point in the boundary of the state constraint set, there exist admissible velocities strictly pointing away from the boundary of the state constraint set. This is a significant restriction, since this 'strict sense' outward/inward pointing condition is violated by control of systems, typically encountered in mechanical control, where the control action affects the rate of change of the state, not directly, but through the intermediary of a dynamic system. A class of control systems has been recently identified that enjoy this interiority property, but for which the strict sense outward pointing condition is violated. These advances have been used to establish uniqueness of continuous viscosity solutions of the relevant Hamilton Jacobi equation for an infinite horizon formulation of the problem involving such systems. In this paper, we exploit this newly discovered property also to provide the desired characterization of the value function for finite horizon problems involving endpoint and pathwise state constraints, when the value function is possibly discontinuous and the traditional strict outward pointing condition is replaced by a softer, second order condition.

Convergence of the solutions of discounted Hamilton--Jacobi systems

Convergence/divergence phenomena in the vanishing discount limit of Hamilton-Jacobi equations

On Convergence to Stochastic Integrals

Generalized convergence of solutions for nonlinear Hamilton-Jacobi equations with state-constraint

Finite-time Convergence of Solutions of Hamilton-Jacobi Equations

Convergence of Newton'S Method for Systems of Equations with Constant Rank Derivatives

On the Negative Limit of Viscosity Solutions for Discounted Hamilton-Jacobi Equations

Coupling and Convergence for Hamiltonian Monte Carlo

Convergence Criterion of Newton's Method for Singular Systems with Constant Rank Derivatives

Overdamped limit of generalized stochastic Hamiltonian systems for singular interaction potentials

Convergence of Viscosity Solutions of Generalized Contact Hamilton–Jacobi Equations

Convergence analysis of inexact proximal point algorithms on Hadamard manifolds

Rate of convergence for homogenization of nonlinear weakly coupled Hamilton-Jacobi systems

Convergence of distorted Brownian motions and singular Hamiltonians

About convergence of solutions of one-dimensional stochastic equations

Almost sure convergence of stochastic Hamiltonian descent methods

Analysis of the vanishing discount limit for optimal control problems in continuous and discrete time

Convergence Criteria for Fixed Point Problems and Differential Equations

Discontinuous solutions to the hamilton jacobi equation under second order interiority hypotheses

A convergence theorem for Crandall-Lions viscosity solutions to path-dependent Hamilton-Jacobi-Bellman PDEs

Optimal convergence rate for homogenization of convex Hamilton–Jacobi equations in the periodic spatial-temporal environment