Abstract:We consider a class of infinite-dimensional singular stochastic control problems. These can be thought of as spatial monotone follower problems and find applications in spatial models of production and climate transition. Let $(D,\mathcal{M},\mu)$ be a finite measure space and consider the Hilbert space $H:=L^2(D,\mathcal{M},\mu; \mathbb{R})$. Let then $X$ be an $H$-valued stochastic process on a suitable complete probability space, whose evolution is determined through an SPDE driven by a self-adjoint linear operator $\mathcal{A}$ and affected by a cylindrical Brownian motion. The evolution of $X$ is controlled linearly via an $H$-valued control consisting of the direction and the intensity of action, a real-valued nondecreasing right-continuous stochastic process, adapted to the underlying filtration. The goal is to minimize a discounted convex cost-functional over an infinite time-horizon. By combining properties of semiconcave functions and techniques from viscosity theory, we first show that the value function of the problem $V$ is a $C^{1,Lip}(H)$-viscosity solution to the corresponding dynamic programming equation, which here takes the form of a variational inequality with gradient constraint. Then, by allowing the decision maker to choose only the intensity of the control and requiring that the given control direction $\hat{n}$ is an eigenvector of the linear operator $\mathcal{A}$, we establish that the directional derivative $V_{\hat{n}}$ is of class $C^1(H)$, hence a second-order smooth-fit principle in the controlled direction holds for $V$. This result is obtained by exploiting a connection to optimal stopping and combining results and techniques from convex analysis and viscosity theory.

Algorithm for Variational Inequality Problems Based on a Gradient Dynamical System Designed Using a Control Liapunov Function

An Improved Smoothing Technique-Based Control Vector Parameterization Method for Optimal Control Problems with Inequality Path Constraints

Control Liapunov function design of neural networks that solve convex optimization and variational inequality problems

Two Novel Algorithms for Solving Variational Inequality Problems Governed by Fixed Point Problems and Their Applications

Modified inertial extragradient methods for finding minimum-norm solution of the variational inequality problem with applications to optimal control problem

A Variational Inequality Approach to Optimal Control Problems with Joint Constraints.

Easily implementable iterative methods for variational inequalities with nonlinear diffusion–convection operator and constraints to the gradient of solution

Self-adaptive inertial single projection methods for variational inequalities involving non-Lipschitz and Lipschitz operators with their applications to optimal control problems

Discrete Variational Optimal Control

A feedback control approach to convex optimization with inequality constraints

Coefficient Control of Variational Inequalities

An Accelerated Extragradient Algorithm for Bilevel Pseudomonotone Variational Inequality Problems with Application to Optimal Control Problems

Variational inequalities and smooth-fit principle for singular stochastic control problems in Hilbert spaces

A Projection-Based Algorithm for Solving Stochastic Inverse Variational Inequality Problems

A Self-Adaptive Inertial Algorithm for Bilevel Pseudo-Monotone Variational Inequality Problems with Non-Lipschitz Mappings

A subgradient-based neurodynamic algorithm to constrained nonsmooth nonconvex interval-valued optimization

Continuous and discrete-time accelerated methods for an inequality constrained convex optimization problem

Variational Dynamic Programming for Stochastic Optimal Control

A Mixed Variable Variational Method for Optimal Control Problems with Applications in Aerospace Control

Well-Posedness and Output Regulation for Implicit Time-Varying Evolution Variational Inequalities

An Optimal Control Problem Governed by Quasi-Linear Variational Inequalities