Viscosity Solutions for HJB Equations on the Process Space: Application to Mean Field Control with Common Noise

Jianjun Zhou,Nizar Touzi,Jianfeng Zhang
2024-01-10
Abstract:In this paper we investigate a path dependent optimal control problem on the process space with both drift and volatility controls, with possibly degenerate volatility. The dynamic value function is characterized by a fully nonlinear second order path dependent HJB equation on the process space, which is by nature infinite dimensional. In particular, our model covers mean field control problems with common noise as a special case. We shall introduce a new notion of viscosity solutions and establish both existence and comparison principle, under merely Lipschitz continuity assumptions. The main feature of our notion is that, besides the standard smooth part, the test function consists of an extra singular component which allows us to handle the second order derivatives of the smooth test functions without invoking the Ishii's lemma. We shall use the doubling variable arguments, combined with the Ekeland-Borwein-Preiss Variational Principle in order to overcome the noncompactness of the state space. A smooth gauge-type function on the path space is crucial for our estimates.
Optimization and Control,Analysis of PDEs
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the path - dependent optimal control problem in the process space, especially when the control acts on both the drift term and the volatility term simultaneously, and the volatility term may be degenerate. The dynamic value function is described by a fully nonlinear second - order path - dependent Hamilton - Jacobi - Bellman (HJB) equation, which is essentially infinite - dimensional. The paper pays special attention to the mean - field control problem including common noise as a special case. ### Problem Background In many practical applications, such as in the fields of financial engineering, biomedicine, and complex - system control, control problems often involve path - dependence, that is, the state of the system depends not only on the current time point but also on the past historical path. This path - dependence makes it difficult to directly apply the traditional finite - dimensional control theory. Moreover, when the system is affected by random noise, the control problem becomes more complicated, especially when these noises are the same for all individuals (i.e., common noise). ### Paper Objectives The main objectives of the paper are to introduce a new concept of viscosity solution and prove its existence and comparison principle. Specifically: 1. **Introduce a new concept of viscosity solution**: In addition to the standard smooth part, the test function also includes an additional singular part, which enables the handling of the second - order derivative of the smooth test function without having to use Ishii's lemma. 2. **Establish existence and comparison principles**: Under the condition of only assuming Lipschitz continuity, the existence and comparison principle of the viscosity solution are proved. 3. **Handle infinite - dimensional HJB equations**: By introducing a new form of test function, the paper overcomes the non - compactness problem of infinite - dimensional HJB equations. ### Main Contributions - **New concept of viscosity solution**: A new form of test function is introduced, including a singular part, which enables the handling of the second - order derivative without using Ishii's lemma. - **Wide applicability**: The method in the paper is applicable to the mean - field control problem including common noise, which is a common situation in many practical problems. - **Technical breakthrough**: By using the Ekeland - Borwein - Preiss variational principle, the non - local compactness problem of the process space is overcome. ### Mathematical Tools - **Path - dependent PDE**: The paper deals with path - dependent partial differential equations (PDEs), which are equations defined on infinite - dimensional spaces. - **Viscosity solution theory**: Viscosity solutions are a concept of weak solutions, applicable to nonlinear PDEs, especially when classical solutions do not exist. - **Variational principle**: The Ekeland - Borwein - Preiss variational principle is used to deal with non - compactness problems and ensure the existence of solutions to optimization problems. ### Application Prospects The results of the paper are of great significance for the development of mean - field control theory, especially when dealing with complex systems including common noise. These results can be applied to risk management in financial engineering, drug design in biomedicine, and optimal control in complex systems.