Abstract:Random terms in many natural and social science systems have distinct Markovian characteristics, such as Markov jump-taking values in a finite or countable set, and Wiener process-taking values in a continuous set. In general, these systems can be seen as Markov-process-driven systems, which can be used to describe more complex phenomena. In this paper, a discrete-time stochastic linear system driven by a homogeneous Markov process is studied, and the corresponding linear quadratic (LQ) optimal control problem for this system is solved. Firstly, the relations between the well-posedness of LQ problems and some linear matrix inequality (LMI) conditions are established. Then, based on the equivalence between the solvability of the generalized difference Riccati equation (GDRE) and the LMI condition, it is proven that the solvability of the GDRE is sufficient and necessary for the well-posedness of the LQ problem. Moreover, the solvability of the GDRE and the feasibility of the LMI condition are established, and it is proven that the LQ problem is attainable through a certain feedback control when any of the four conditions is satisfied, and the optimal feedback control of the LQ problem is given using the properties of homogeneous Markov processes and the smoothness of the conditional expectation. Finally, a practical example is used to illustrate the validity of the theory.

Stochastic LQ Control Framework for the Hedging Problem as the Stock Price Follows Jump-diffusion Process

Foreign equity option pricing under stochastic volatility model with double jumps

A Jump-Diffusion Approach to Modelling Vulnerable Option Pricing

The double exponential jump diffusion model for pricing European options under fuzzy environments

Dynamic Asset Allocation with Jump Risk

Mean-Field Stochastic Linear Quadratic Optimal Control for Jump-Diffusion Systems with Hybrid Disturbances

A Stochastic Maximum Principle for a Markov Regime-Switching Jump-Diffusion Model and Its Application to Finance

Non-homogeneous stochastic LQ control with regime switching and random coefficients

Stabilization of delayed neutral semi-Markovian jumping stochastic systems driven by fractional Brownian motions: H ∞ control approach

Reinforcement Learning for Jump-Diffusions, with Financial Applications

Optimal Controls of Stochastic Differential Equations with Jumps and Random Coefficients: Stochastic Hamilton–Jacobi–Bellman Equations with Jumps

Asynchronous Control for Discrete-Time Markovian Jump Systems with Multiplicative Noise

Robust control for uncertain systems with time-delay and jump parameters*

Stochastic linear quadratic optimal control problems with regime-switching jumps in infinite horizon

Linear Quadratic Optimal Control of Discrete-Time Stochastic Systems Driven by Homogeneous Markov Processes

Finite Horizon Stochastic H2/H∞ Control for Continuous‐Time Systems Driven by G‐Brownian Motion

Mean-variance portfolio selection in jump-diffusion model under no-shorting constraint: A viscosity solution approach

Stochastic Intermittent Control with Uncertainty

Robust finite-time H2/H∞ control for stochastic Markovian jump systems via state feedback

Comparison theorems for multi-dimensional BSDEs with jumps and applications to constrained stochastic linear-quadratic control

Infinite time horizon stochastic recursive control problems with jumps: dynamic programming and stochastic verification theorems