Abstract:An optimal control for a dynamical system optimizes a certain objective function. Here we consider the construction of an optimal control for a stochastic dynamical system with a random structure, Poisson perturbations and random jumps, which makes the system stable in probability. Sufficient conditions of the stability in probability are obtained, using the second Lyapunov method, in which the construction of the corresponding functions plays an important role. Here we provide a solution to the problem of optimal stabilization in a general case. For a linear system with a quadratic quality function, we give a method of synthesis of optimal control based on the solution of Riccati equations. Finally, in an autonomous case, a system of differential equations was constructed to obtain unknown matrices that are used for the building of an optimal control. The method of a small parameter is justified for the algorithmic search of an optimal control. This approach brings a novel solution to the problem of optimal stabilization for a stochastic dynamical system with a random structure, Markov switches and Poisson perturbations.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to construct optimal control for stochastic dynamical systems with random structures, Markovian switching and Poisson perturbations, so as to make them probabilistically stable. Specifically, the author has studied how to achieve the optimal stabilization of the system by constructing an appropriate Lyapunov function, and has given a method for solving the optimal control based on the Riccati equation in linear systems. ### Main Problem Description 1. **System Description**: - This paper considers a class of stochastic dynamical systems described by Ito stochastic differential equations (SDEs), which include Poisson perturbations and external random jumps. - The system also has Markovian switching characteristics, that is, the structure of the system can randomly switch among different states. 2. **Stability Problem**: - The main objective of the paper is to make the system probabilistically stable. To this end, the author uses the second Lyapunov method, in which constructing a suitable Lyapunov function plays a crucial role. - The author has derived sufficient conditions for the system to be probabilistically stable and has proven these conditions. 3. **Optimal Control Problem**: - On the basis of ensuring system stability, the author further explores how to design an optimal control strategy to optimize a given objective function. - For linear systems and quadratic cost functions, the author proposes an optimal control synthesis method based on the Riccati equation. ### Solution Overview - **Lyapunov Function**: By constructing an appropriate Lyapunov function, the stability of the system can be verified. The author defines a discrete Lyapunov operator and uses its properties to prove the probabilistic stability of the system. - **Optimal Control Synthesis**: For linear systems, the author determines the optimal control strategy by solving the Riccati equation. The specific steps include: - Constructing a quadratic cost function. - Deriving the Riccati matrix differential equation. - Solving this equation to obtain the optimal control law. - **Algorithm Implementation**: The author also provides an algorithm based on the small - parameter method for searching for the optimal control strategy. This method is applicable to non - autonomous systems and can be verified by numerical simulation. ### Formula Summary - **Lyapunov Operator**: \[ (lv_k)(y,h,x)=\int_{Y\times H\times R^m}P_k((y,h,x),du\times dz\times dl)v_{k + 1}(u,z,l)-v_k(y,h,x) \] - **Riccati Matrix Differential Equation**: \[ \frac{dG_{ik}(t)}{dt}+G_{ik}(t)A_i(t)-B_i(t)D^{-1}_{ik}(t)B^T_i(t)G_{ik}(t)+\text{other terms}=0 \] where \(G_{ik}(t)\) is the matrix to be solved. Through these methods, the author has successfully solved the optimal stabilization problem of stochastic dynamical systems with random structures, Markovian switching and Poisson perturbations.

Stabilization of stochastic dynamical systems of a random structure with Markov switches and Poisson perturbations

Direct control method for improving stability and reliability of nonlinear stochastic dynamical systems

Optimal Vibration Control of a Class of Nonlinear Stochastic Systems with Markovian Jump

Stochastic stabilization of quasi-generalized Hamiltonian systems

Stochastic Stabilization of Quasi-Partially Integrable Hamiltonian Systems by Using Lyapunov Exponent

Stability and Stabilization of a Class of Switched Stochastic Systems with Saturation Control

Logic-Based Switching Control for Stabilization of Stochastic Feedforward Nonlinear Systems

Stability of stochastic dynamic systems of a random structure with Markov switchings in the presence of concentration points

Brief paper: Stochastic minimax control for stabilizing uncertain quasi- integrable Hamiltonian systems

A Stochastic Optimal Time-Delay Control for Nonlinear Structural Systems

Nonlinear Optimal Control for Stochastic Dynamical Systems

Robust Stabilization of Stochastic Singular Systems with Markovian Switching

Linear Quadratic Optimal Control and Stabilization for Discrete-time Markov Jump Linear Systems

Finite-time Stability and Stabilization of Markovian Switching Stochastic Systems with Impulsive Effects

Control design for partial stabilization of nonlinear mechanical systems with random disturbances

Almost Sure Stability of Switched Stochastic Systems with Impulsive Effects

Stability and Stabilization for Positive Systems with Semi-Markov Switching

Optimal Control and Stabilization Problem for Discrete-time Markov Jump Systems with Indefinite Weight Costs

Optimal Control of a Stochastic Power System -- Algorithms and Mathematical Analysis

Stochastic Stability and Stabilization of Positive Systems with Markovian Jump Parameters

Analysis of Stability and Robust Stability for Stochastic Hybrid Systems with Impulsive Effects