Abstract:This paper investigates a stochastic linear-quadratic (SLQ, for short) control problem regulated by a time-invariant Markov chain in infinite horizon. Under the $L^2$-stability framework, we study a class of linear backward stochastic differential equations (BSDE, for short) in infinite horizon and discuss the open-loop and closed-loop solvabilities of the SLQ problem. The open-loop solvability is characterized by the solvability of a system of coupled forward-backward stochastic differential equations (FBSDEs, for short) in infinite horizon and the convexity of the cost functional, and the closed-loop solvability is shown to be equivalent to the open-loop solvability, which in turn is equivalent to the existence of a static stabilizing solution to the associated constrained coupled algebra Riccati equations (CAREs, for short). Under the uniform convexity assumption, we obtain the unique solvability of associated CAREs and construct the corresponding closed-loop optimal control. Finally, we also solve a class of discounted SLQ problems and give two concrete examples to illustrate the results developed in the earlier sections.

The Stochastic Maximum Principle for Relaxed Control Problem with Regime-Switching

Optimal Control of Markov Regime-Switching Stochastic Recursive Utilities

Non-homogeneous stochastic LQ control with regime switching and random coefficients

Maximum principle for a stochastic delayed system involving terminal state constraints

Maximum Principle for Markov Regime-Switching Forward–Backward Stochastic Control System with Jumps and Relation to Dynamic Programming

A General Stochastic Maximum Principle for a Markov Regime Switching Jump-Diffusion Model of Mean-Field Type

Stochastic Maximum Principle for Subdiffusions and Its Applications

Maximum principle for stochastic control of SDEs with measurable drifts

Stochastic maximum principle for sub-diffusions and its applications

Stochastic maximum principle for optimal control problem with varying terminal time and non-convex control domain

Maximum Principles of Markov Regime-Switching Forward-Backward Stochastic Differential Equations with Jumps and Partial Information

A Stochastic Maximum Principle for a Markov Regime-Switching Jump-Diffusion Model and Its Application to Finance

Stochastic linear quadratic optimal control problems with regime-switching jumps in infinite horizon

The Relaxed Stochastic Maximum Principle in Singular Optimal Control of SDEs for Mean-field Type

A Stochastic Maximum Principle for a Markov Regime-Switching Jump-Diffusion Model with Delay and an Application to Finance

Stochastic maximum principle for recursive optimal control problems with varying terminal time

Stochastic linear-quadratic optimal control problems with non-Markovian regime switching

A maximum principle for controlled time-symmetric forward-backward doubly stochastic differential equation with initial-terminal sate constraints

Maximum Principle for the Stochastic Optimal Control Problem with Delay and Application

Controllability of Stochastic Differential Equations with Markovian Switching