Mathematical Control Theory for Stochastic Partial Differential Equations

Qi Lü,Xu Zhang

DOI: https://doi.org/10.1007/978-3-030-82331-3

2021-01-01

Abstract:Monograph on Stochastic evolution equation, control theory, controllability, observability, optimal control, global Carleman estimate.

What problem does this paper attempt to address?

A CONCISE INTRODUCTION TO CONTROL THEORY FOR STOCHASTIC PARTIAL DIFFERENTIAL EQUATIONS

Qi Lu,Xu Zhang

DOI: https://doi.org/10.3934/mcrf.2021020

2020-01-01

Mathematical Control and Related Fields

Abstract:The aim of this notes is to give a concise introduction to control theory for systems governed by stochastic partial differential equations. We shall mainly focus on controllability and optimal control problems for these systems. For the first one, we present results for the exact controllability of stochastic transport equations, null and approximate controllability of stochastic parabolic equations and lack of exact controllability of stochastic hyperbolic equations. For the second one, we first introduce the stochastic linear quadratic optimal control problems and then the Pontryagin type maximum principle for general optimal control problems. It deserves mentioning that, in order to solve some difficult problems in this field, one has to develop new tools, say, the stochastic transposition method introduced in our previous works.
Control theory for stochastic distributed parameter systems, an engineering perspective

Qi Lü,Xu Zhang

DOI: https://doi.org/10.1016/j.arcontrol.2021.04.002

IF: 9.4

2021-01-01

Annual Reviews in Control

Abstract:The main purpose of this paper is to survey some recent progresses on control theory for stochastic distributed parameter systems, i.e., systems governed by stochastic differential equations in infinite dimensions, typically by stochastic partial differential equations. We will explain the new phenomenon and difficulties in the study of controllability and optimal control problems for one dimensional stochastic parabolic equations and stochastic hyperbolic equations. In particular, we shall see that both the formulation of corresponding stochastic control problems and the tools to solve them may differ considerably from their deterministic/finite-dimensional counterparts. More importantly, one has to develop new tools, say, the stochastic transposition method introduced in our previous works, to solve some problems in this field.

automation & control systems
A Mini-Course on Stochastic Control

Qi Lu,Xu Zhang

DOI: https://doi.org/10.48550/arXiv.1612.02523

2016-12-08

Abstract:This note is addressed to giving a short introduction to control theory of stochastic systems, governed by stochastic differential equations in both finite and infinite dimensions. We will mainly explain the new phenomenon and difficulties in the study of controllability and optimal control problems for these sort of equations. In particular, we will show by some examples that both the formulation of stochastic control problems and the tools to solve them may differ considerably from their deterministic counterpart.

Optimization and Control
Control Problems for Stochastic Distributed Parameter Systems

Qi Lü,Xu Zhang

DOI: https://doi.org/10.1007/978-3-030-82331-3_5

2021-01-01

Abstract:In this chapter, we shall present several typical controlled stochastic evolution equations, including a new refined controlled stochastic wave equation in particular. Then, we shall give a quite general formulation of some typical control problems, such as controllability/observability problems and optimal control problems for stochastic distributed parameter systems.
A unified controllability/observability theory for some stochastic and deterministic partial differential equations

Xu Zhang

DOI: https://doi.org/10.48550/arXiv.1003.5819

2010-03-30

Abstract:The purpose of this paper is to present a universal approach to the study of controllability/observability problems for infinite dimensional systems governed by some stochastic/deterministic partial differential equations. The crucial analytic tool is a class of fundamental weighted identities for stochastic/deterministic partial differential operators, via which one can derive the desired global Carleman estimates. This method can also give a unified treatment of the stabilization, global unique continuation, and inverse problems for some stochastic/deterministic partial differential equations.

Optimization and Control
Stochastic Well-posed Systems and Well-posedness of Some Stochastic Partial Differential Equations with Boundary Control and Observation

Qi Lu

DOI: https://doi.org/10.48550/arXiv.1501.01737

2015-07-06

Abstract:We generalize the concept "well-posed linear system" to stochastic linear control systems and study some basic properties of such kind systems. Under our generalized definition, we show the well-posedness of the stochastic heat equation and the stochastic Schrödinger equation with suitable boundary control and observation operators, respectively.

Optimization and Control
Controllability and Observability of Stochastic Parabolic Systems

Qi Lü,Xu Zhang

DOI: https://doi.org/10.1007/978-3-030-82331-3_9

2021-01-01

Abstract:This chapter is devoted to studying the null/approximate controllability and observability of stochastic parabolic systems.
On Stochastic Optimal Control of Partially Observable Nonlinear Quasi Hamiltonian Systems

Wei-qui Zhu,Zu-guang Ying

DOI: https://doi.org/10.1007/s11433-010-0081-6

IF: 4.7

2007-01-01

Journal of Sound and Vibration

Abstract:A stochastic optimal control strategy for partially observable nonlinear quasi Hamiltonian systems is proposed. The optimal control forces consist of two parts. The first part is determined by the conditions under which the stochastic optimal control problem of a partially observable nonlinear system is converted into that of a completely observable linear system. The second part is determined by solving the dynamical programming equation derived by applying the stochastic averaging method and stochastic dynamical programming principle to the completely observable linear control system. The response of the optimally controlled quasi Hamiltonian system is predicted by solving the averaged Fok-ker-Planck-Kolmogorov equation associated with the optimally controlled completely observable linear system and solving the Riccati equation for the estimated error of system states. An example is given to illustrate the procedure and effectiveness of the proposed control strategy.
Exact Controllability for Stochastic Transport Equations

Qi Lu

DOI: https://doi.org/10.1137/130910373

IF: 2.2

2014-01-01

SIAM Journal on Control and Optimization

Abstract:This paper studies the exact controllability for stochastic transport equations by two controls: one is a boundary control imposed on the drift term and the other is an internal control imposed on the diffusion term. By means of the duality argument, this controllability problem can be reduced to an observability problem for backward stochastic transport equations, and the desired observability estimate is obtained by a new global Carleman estimate. Also, we present some results about the lack of exact controllability, which show that the action of two controls is necessary. To some extent, this indicates that the controllability problems for stochastic PDEs differ from their deterministic counterpart.
Stochastic Evolution Equations of Jump Type with Random Coefficients: Existence, Uniqueness and Optimal Control.

Maoning Tang,Qingxin Meng

DOI: https://doi.org/10.1007/s11432-016-9107-1

2017-01-01

Science China Information Sciences

Abstract:We study a class of stochastic evolution equations of jump type with random coefficients and its optimal control problem. There are three major ingredients. The first is to prove the existence and uniqueness of the solutions by continuous dependence theorem of solutions combining with the parameter extension method. The second is to establish the stochastic maximum principle and verification theorem for our optimal control problem by the classic convex variation method and dual technique. The third is to represent an example of a Cauchy problem for a controlled stochastic partial differential equation with jumps which our theoretical results can solve.
ADVANCES IN RESEARCH ON NONLINEAR STOCHASTIC OPTIMAL CONTROL OF QUASI-HAMILTONIAN SYSTEMS

朱位秋,应祖光

DOI: https://doi.org/10.6052/1000-0992-12-045

2013-01-01

Abstract:Advances in the theory of nonlinear stochastic optimal control of quasi-Hamiltonian systems and its applications in the last decade is summarized. It includes: (1) the basic nonlinear stochastic optimal control strategies based on the stochastic averaging method for quasi-Hamiltonian systems and the stochastic dynamical programming principle, that is, response minimization control, stochastic stabilization, first-passage failure minimization control, and the control for targeting a specified stationary probability density function; (2) further study on the nonlinear stochastic optimal control for application, such as optimal control of partially observable systems, bounded optimal control, time-delay optimal control, semi-active optimal control and minimax control; (3) the integrated nonlinear stochastic optimal control strategy; (4) the applications of the nonlinear stochastic optimal control strategy to engineering structures including hysteretic systems and fractional derivative systems. Some related background and problems to be studied in future are also pointed out.
On the existence of optimal controls for backward stochastic partial differential equations

Qingxin Meng,Yang Shen,Peng Shi

DOI: https://doi.org/10.1016/j.spl.2018.01.013

IF: 0.718

2018-01-01

Statistics & Probability Letters

Abstract:This paper is concerned with the existence of optimal controls for backward stochastic partial differential equations with random coefficients, in which the control systems are represented in an abstract evolution form, i.e. backward stochastic evolution equations. Under some growth and monotonicity conditions on the coefficients and suitable assumptions on the Hamiltonian, the existence of the optimal control boils down to proving the uniqueness and existence of a solution to the stochastic Hamiltonian system, i.e. a fully coupled forward–backward stochastic evolution equation. Using some a prior estimates, we prove the uniqueness and existence of the solution via the method of continuation. Two examples of linear–quadratic control are solved to demonstrate our results.
Stochastic Differential Equations and Stochastic Linear Quadratic Optimal Control Problem with Lévy Processes

Huaibin Tang,Zhen Wu

DOI: https://doi.org/10.1007/s11424-009-9151-0

2009-01-01

Abstract:In this paper, the authors first study two kinds of stochastic differential equations (SDEs) with Lévy processes as noise source. Based on the existence and uniqueness of the solutions of these SDEs and multi-dimensional backward stochastic differential equations (BSDEs) driven by Lévy processes, the authors proceed to study a stochastic linear quadratic (LQ) optimal control problem with a Lévy process, where the cost weighting matrices of the state and control are allowed to be indefinite. One kind of new stochastic Riccati equation that involves equality and inequality constraints is derived from the idea of square completion and its solvability is proved to be sufficient for the well-posedness and the existence of optimal control which can be of either state feedback or open-loop form of the LQ problems. Moreover, the authors obtain the existence and uniqueness of the solution to the Riccati equation for some special cases. Finally, two examples are presented to illustrate these theoretical results.
Optimal Feedback Controls of Stochastic Linear Quadratic Control Problems in Infinite Dimensions with Random Coefficients

Qi Lü,Tianxiao Wang

DOI: https://doi.org/10.48550/arXiv.2202.10212

2022-02-21

Abstract:It is a longstanding unsolved problem to characterize the optimal feedback controls for general linear quadratic optimal control problem of stochastic evolution equation with random coefficients. A solution to this problem is given in [21] under some assumptions which can be verified for interesting concrete models, such as controlled stochastic wave equations, controlled stochastic Schrödinger equations, etc. More precisely, the authors establish the equivalence between the existence of optimal feedback operator and the solvability of the corresponding operator-valued, backward stochastic Riccati equations. However, their result cannot cover some important stochastic partial differential equations, such as stochastic heat equations, stochastic stokes equations, etc. A key contribution of the current work is to relax the $C_0$-group assumption of unbounded linear operator $A$ in [21] and using contraction semigroup assumption instead. Therefore, our result can be well applicable in the linear quadratic problem of stochastic parabolic partial differential equations. To this end, we introduce a suitable notion to the aforementioned Riccati equation, and some delicate techniques which are even new in the finite dimensional case.

Optimization and Control
Exact Controllability for Stochastic Schrodinger Equations

Qi Lu

DOI: https://doi.org/10.48550/arXiv.1304.7136

2013-04-26

Abstract:This paper is addressed to studying the exact controllability for stochastic Schrödinger equations by two controls. One is a boundary control in the drift term and the other is an internal control in the diffusion term. By means of the standard duality argument, the control problem is converted into an observability problem for backward stochastic Schrödinger equations, and the desired observability estimate is obtained by a global Carleman estimate. At last, we give a result about the lack of exact controllability, which shows that the action of two controls is necessary.

Optimization and Control
Necessary and Sufficient Conditions for Optimal Control of Stochastic Systems Associated with Lévy Processes

QingXin Meng,MaoNing Tang

DOI: https://doi.org/10.1007/s11432-009-0191-9

2009-01-01

Abstract:The paper is concerned with a stochastic optimal control problem where the controlled systems are driven by Teugel's martingales and an independent multi-dimensional Brownian motion. Necessary and sufficient conditions for an optimal control of the control problem with the control domain being convex are proved by the classical method of convex variation, and the coefficients appearing in the systems are allowed to depend on the control variables. As an application, the linear quadratic stochastic optimal control problem is studied.
Stochastic Evolution Equation Driven by Teugels Martingale and Its Optimal Control

Qingxin Meng,Qiuhong Shi,Maoning Tang

DOI: https://doi.org/10.48550/arXiv.1707.08889

2017-07-26

Abstract:The paper is concerned with a class of stochastic evolution equations in Hilbert space with random coefficients driven by Teugel's martingales and an independent multi-dimensional Brownian motion and its optimal control problem. Here Teugels martingales are a family of pairwise strongly orthonormal martingales associated with Lévy processes (see Nualart and Schoutens). There are three major ingredients. The first is to prove the existence and uniqueness of the solutions by continuous dependence theorem of solutions combining with the parameter extension method. The second is to establish the stochastic maximum principle and verification theorem for our optimal control problem by the classic convex variation method and dual technique. The third is to represent an example of a Cauchy problem for a controlled stochastic partial differential equation driven by Teugels martingales which our theoretical results can solve.

Probability
On the Existence of Stochastic Optimal Control of Distributed State System

R Buckdahn,A Rascanu

DOI: https://doi.org/10.1016/s0362-546x(02)00158-x

IF: 1.743

2002-01-01

Nonlinear Analysis

Abstract:An optimal control problem governed by a semilinear parabolic stochastic differential equation with nonlinear diffusion coefficient is studied and the existence of a quasi-optimal (nonrelaxed) control is proved without assuming convexity of the coefficients. The control state space is not compact and of infinite dimension, the stochastic equation is driven by a cylindrical Brownian motion.
Partial Approximate Controllability for Linear Stochastic Control Systems

Fangfang Dou,Qi Lu

DOI: https://doi.org/10.1137/18m1164640

IF: 2.2

2019-01-01

SIAM Journal on Control and Optimization

Abstract:This paper is devoted to studying controllability problems of linear stochastic control systems with controls only in the drift terms. It is well known that such a system is not exactly controllable. We first construct an example to show that it is also not approximately controllable under some natural condition. Next we introduce the notion of partial approximate controllability and reveal that it is equivalent to some weak unique continuation property of backward stochastic evolution equations. Then we prove that this kind of unique continuation property holds. Finally, two examples concerning controlled stochastic parabolic and stochastic Schrodinger equations are presented.
Stability Analysis and Optimal Control of Stochastic Singular Systems.

Qingling Zhang,Shuangyun Xing

DOI: https://doi.org/10.1007/s11590-013-0687-5

IF: 1.5288

2013-01-01

Optimization Letters

Abstract:In this paper, problems of stability and optimal control for a class of stochastic singular systems are studied. Firstly, under some appropriate assumptions, some new results about mean-square admissibility are developed and the corresponding LMI sufficient condition is given. Secondly, finite-time horizon and infinite-time horizon linear quadratic (LQ) control problems for the stochastic singular system are investigated, in which the coefficients are allowed to be random in control input and quadratic criterion. Some results involving new stochastic generalized Riccati equation are discussed as well. Finally, the proposed LQ control model for stochastic singular systems provides an appropriate and effective framework to study the portfolio selection problem in light of the recent development on general stochastic LQ problems.

Mathematical Control Theory for Stochastic Partial Differential Equations

A CONCISE INTRODUCTION TO CONTROL THEORY FOR STOCHASTIC PARTIAL DIFFERENTIAL EQUATIONS

Control theory for stochastic distributed parameter systems, an engineering perspective

A Mini-Course on Stochastic Control

Control Problems for Stochastic Distributed Parameter Systems

A unified controllability/observability theory for some stochastic and deterministic partial differential equations

Stochastic Well-posed Systems and Well-posedness of Some Stochastic Partial Differential Equations with Boundary Control and Observation

Controllability and Observability of Stochastic Parabolic Systems

On Stochastic Optimal Control of Partially Observable Nonlinear Quasi Hamiltonian Systems

Exact Controllability for Stochastic Transport Equations

Stochastic Evolution Equations of Jump Type with Random Coefficients: Existence, Uniqueness and Optimal Control.

ADVANCES IN RESEARCH ON NONLINEAR STOCHASTIC OPTIMAL CONTROL OF QUASI-HAMILTONIAN SYSTEMS

On the existence of optimal controls for backward stochastic partial differential equations

Stochastic Differential Equations and Stochastic Linear Quadratic Optimal Control Problem with Lévy Processes

Optimal Feedback Controls of Stochastic Linear Quadratic Control Problems in Infinite Dimensions with Random Coefficients

Exact Controllability for Stochastic Schrodinger Equations

Necessary and Sufficient Conditions for Optimal Control of Stochastic Systems Associated with Lévy Processes

Stochastic Evolution Equation Driven by Teugels Martingale and Its Optimal Control

On the Existence of Stochastic Optimal Control of Distributed State System

Partial Approximate Controllability for Linear Stochastic Control Systems

Stability Analysis and Optimal Control of Stochastic Singular Systems.