Abstract:This paper concerns the characterization of a lower semicontinuous value function in terms of the unique generalized solution of the Hamilton Jacobi equation (HJE), for optimal control problems with end point and pathwise state constraints. There is an extensive literature on this topic, in the contexts both of finite and infinite horizon problems. A key step in establishing this link is to validate a certain 'interiority' property, specifically to show that an arbitrary state trajectory satisfying the state constraint can be approximated by an interior state trajectory. The step has traditionally been accomplished under the hypothesis that, at each point in the boundary of the state constraint set, there exist admissible velocities strictly pointing away from the boundary of the state constraint set. This is a significant restriction, since this 'strict sense' outward/inward pointing condition is violated by control of systems, typically encountered in mechanical control, where the control action affects the rate of change of the state, not directly, but through the intermediary of a dynamic system. A class of control systems has been recently identified that enjoy this interiority property, but for which the strict sense outward pointing condition is violated. These advances have been used to establish uniqueness of continuous viscosity solutions of the relevant Hamilton Jacobi equation for an infinite horizon formulation of the problem involving such systems. In this paper, we exploit this newly discovered property also to provide the desired characterization of the value function for finite horizon problems involving endpoint and pathwise state constraints, when the value function is possibly discontinuous and the traditional strict outward pointing condition is replaced by a softer, second order condition.

On Viscosity Solution of Hjb Equations with State Constraints and Reflection Control

On the Viscosity Solutions of Hybrid HJB Equations Arising in Optimal Control of Loss Networks.

A viscosity solution approach to the infinite dimensional HJB related to boundary control problem in transport equation

Viscosity Solutions for HJB Equations on the Process Space: Application to Mean Field Control with Common Noise

Optimal control problem for reflected McKean-Vlasov SDEs

Viscosity Solutions to Second Order Path-Dependent Hamilton-Jacobi-Bellman Equations and Applications

Viscosity Solutions of a class of Second Order Hamilton-Jacobi-Bellman Equations in the Wasserstein Space

A Viscosity Solution Theory of Stochastic Hamilton-Jacobi-Bellman equations in the Wasserstein Space

Uniqueness of Viscosity Solutions of Stochastic Hamilton-Jacobi Equations

Stochastic Recursive Optimal Control of McKean-Vlasov Type: A Viscosity Solution Approach

Optimal Control of Unbounded Functional Stochastic Evolution Systems in Hilbert Spaces: Second-Order Path-dependent HJB Equation

State and Control Path-Dependent Stochastic Zero-Sum Differential Games: Viscosity Solutions of Path-Dependent Hamilton-Jacobi-Isaacs Equations

The optimal control related to Riemannian manifolds and the viscosity solutions to H-J-B equations

Optimal control problems of fully coupled FBSDEs and viscosity solutions of Hamilton-Jacobi-Bellman equations

Singular Control of (Reflected) Brownian Motion: A Computational Method Suitable for Queueing Applications

Controlled Occupied Processes and Viscosity Solutions

Stochastic optimal self-path-dependent control: A new type of variational inequality and its viscosity solution

System of Nonlinear Second-Order Parabolic Partial Differential Equations with Interconnected Obstacles and Oblique Derivative Boundary Conditions on Non-Smooth Time-Dependent Domains

Path-Dependent Optimal Stochastic Control and Viscosity Solution of Associated Bellman Equations

Existence of viscosity solutions for Hamilton-Jacobi equations on Riemannian Manifolds via Lyapunov control

Discontinuous solutions to the hamilton jacobi equation under second order interiority hypotheses