Abstract:The First, by applying the maximum principle to the discrete‐time linear systems and the quadratic cost function involving input delay and Markovian packet dropouts, a solution to the forward and backward stochastic difference equations (FBSDEs) is derived.Second, a sufficient and necessary condition for the optimal control problem is obtained by decoupling the coupled Riccati equations.Finally, the explicit solution of the optimal controller is presented based on the complete square method. This article investigates the finite horizon linear quadratic gaussian (LQG) control problem for networked control systems with two‐way Markovian packet dropouts and input delay, where packet dropouts occur from the sensor to the estimator and from the controller to the actuator, and delay occurs from the controller to the actuator. The novelty of this work lies in providing a complete solution for the optimal control problem subject to two‐way Markovian packet dropouts and input delay. The contributions of this article are as follows: first, by applying the maximum principle to the discrete‐time linear systems and the quadratic cost function involving input delay and Markovian packet dropouts, a solution to the forward and backward stochastic difference equations (FBSDEs) is derived. Second, a sufficient and necessary condition for the optimal control problem is obtained by decoupling the coupled Riccati equations. Finally, the explicit solution of the optimal controller is presented based on the complete square method. Numerical examples are provided to demonstrate the validity of the theoretical results.

Optimal Linear‐quadratic‐gaussian Control for Discrete‐time Linear Systems with White and Time‐correlated Measurement Noises

Optimal Guaranteed Cost Control for a Class of Linear Uncertain Time-Delay Systems

Lmi Approach To Optimal Guaranteed Cost Control For A Class Of Linear Uncertain Discrete Systems

Time-delayed Feedback Control Optimization for Quasi Linear Systems under Random Excitations

Probabilistic Tracking Control of Dissipated Hamiltonian Systems Excited by Gaussian White Noises.

Optimal Adaptive Control of Linear Stochastic Systems with Quadratic Cost Function

Approximate Optimal Control over Unreliable Communication Channels

Control for Multiplicative Noise Systems with Packet Dropouts and Multiple Delays

Optimal quantized feedback control for linear quandratic Gaussian systems with input delay

Optimal Estimation and Control for Lossy Network: Stability, Convergence, and Performance

A Stochastic Optimal Time-Delay Control for Nonlinear Structural Systems

Optimal Covariance Steering for Continuous-Time Linear Stochastic Systems With Additive Noise

Discrete‐time linear quadratic gaussian control with input delay and Markovian packet dropouts

Infinite-Horizon Linear-Quadratic-Gaussian Control with Costly Measurements

Linear Quadratic Regulation and Stabilization of Discrete-Time Systems With Delay and Multiplicative Noise

Near-Optimal Control for Time-Varying Linear Discrete Systems with Additive Nonlinearities and Random Gains

Optimal control of a linear system with multiplicative noise at control parameter

Distributionally Robust Linear Quadratic Control

Optimal Controller and Quantizer Selection for Partially Observable Linear-Quadratic-Gaussian Systems

Continuous time Stochastic optimal control under discrete time partial observations

Indefinite quadratic with linear costs optimal control of Markov jump with multiplicative noise systems