Abstract:In this paper, we firstly design an adaptive event triggering mechanism with adjustable parameters to regulate the threshold value to reduce the communication resource utilization. Then we combine the observer NN, Crtic NN and Actor NN designed in the paper to obtain the optimal controller based on adaptive dynamic planning with policy iteration. Meanwhile, the impact of DoS attacks on the system is reduced by the designed observer. This article addresses adaptive event‐triggered discrete‐time nonlinear Markov jump systems (MJs) with DoS attacks, where the introduced DoS attacks are considered as more general stochastic models with fixed trigger frequency and duration. To solve the optimal control problem, we use an adaptive dynamic programming (ADP) algorithm based on policy iteration (PI). The approximate process is as follows: the performance index function (PIF) is first updated by the iteration policy in advance, and the control policy is obtained from the PIF. Subsequently, an approximate estimation of the optimal PIF and the optimal control policy is made using the actor‐critic structure obtained through neural network techniques. In order to reduce the occupied communication resources required for control policy iteration, we introduce an adaptive event triggering mechanism with an adaptive triggering threshold, which reduces the conservatism of resource occupation by the PIF compared to the fixed‐threshold ETM. In addition, an observer identifying the unknown dynamics part of the system is designed. Finally, using the Lyapunov function, it is shown that the designed control policy ensures the stability and convergence of the MJS, and the designed observer is effective. Simulation examples are given to verify the feasibility of the controller and the observer.

Dynamic event-triggered control for discrete-time nonlinear Markov jump systems using policy iteration-based adaptive dynamic programming

Dynamic Event-Triggered Asynchronous MPC of Markovian Jump Systems with Disturbances

Adaptive event‐triggered control and observer design for discrete‐time nonlinear Markov jump systems with DoS attacks using policy iteration‐based adaptive dynamic programming

Asynchronous Event-Triggered Output-Feedback Control of Singular Markov Jump Systems

Optimal Control of Markovian Jump Systems Via a Neural Network-Based ADP Iterative Algorithm

Policy Iteration-Based Adaptive Optimal Control for Markov Jump Systems: a Transition-Probability-free Asynchronous Approach

Data-Driven Event-Triggered Adaptive Dynamic Programming Control for Nonlinear Systems with Input Saturation.

Event-triggered optimal decentralized control for stochastic interconnected nonlinear systems via adaptive dynamic programming

Asynchronous Event-triggered Control for Polynomial Fuzzy-Model-Based Markov Jump Systems with Complex Transition Probabilities

Model-free Adaptive Dynamic Programming for Optimal Control of Discrete-time Affine Nonlinear System

Multi-step Heuristic Dynamic Programming for Optimal Control of Nonlinear Discrete-Time Systems.

Adaptive Dynamic Programming for Optimal Control of Discrete-Time Nonlinear Systems with Trajectory-Based Initial Control Policy

Twin Deterministic Policy Gradient Adaptive Dynamic Programming for Optimal Control of Affine Nonlinear Discrete-time Systems

Event-Triggered Adaptive Dynamic Programming for Continuous-Time Systems with Control Constraints

Fuzzy-Based Adaptive Optimization of Unknown Discrete-Time Nonlinear Markov Jump Systems With Off-Policy Reinforcement Learning

Optimal control of nonlinear system based on deterministic policy gradient with eligibility traces

Adaptive Dynamic Programming Based Event-Triggered Control for Unknown Continuous-Time Nonlinear Systems with Input Constraints

Output Tracking Control Based on Adaptive Dynamic Programming with Multistep Policy Evaluation

Event-Triggered Adaptive Dynamic Programming for Unmatched Uncertain Nonlinear Continuous-Time Systems

Event-triggered design for discrete-time nonlinear systems with control constraints

Constrained Event-Triggered H∞ Control Based on Adaptive Dynamic Programming with Concurrent Learning