Abstract:The First, by applying the maximum principle to the discrete‐time linear systems and the quadratic cost function involving input delay and Markovian packet dropouts, a solution to the forward and backward stochastic difference equations (FBSDEs) is derived.Second, a sufficient and necessary condition for the optimal control problem is obtained by decoupling the coupled Riccati equations.Finally, the explicit solution of the optimal controller is presented based on the complete square method. This article investigates the finite horizon linear quadratic gaussian (LQG) control problem for networked control systems with two‐way Markovian packet dropouts and input delay, where packet dropouts occur from the sensor to the estimator and from the controller to the actuator, and delay occurs from the controller to the actuator. The novelty of this work lies in providing a complete solution for the optimal control problem subject to two‐way Markovian packet dropouts and input delay. The contributions of this article are as follows: first, by applying the maximum principle to the discrete‐time linear systems and the quadratic cost function involving input delay and Markovian packet dropouts, a solution to the forward and backward stochastic difference equations (FBSDEs) is derived. Second, a sufficient and necessary condition for the optimal control problem is obtained by decoupling the coupled Riccati equations. Finally, the explicit solution of the optimal controller is presented based on the complete square method. Numerical examples are provided to demonstrate the validity of the theoretical results.

Linear–quadratic optimal control for time-delay stochastic system with recursive utility under full and partial information

Optimal Guaranteed Cost Control for a Class of Linear Uncertain Time-Delay Systems

Linear-quadratic Optimal Control Problems of State Delay Systems under Full and Partial Information

Delayed Stochastic Linear-Quadratic Control Problem and Related Applications

The Quadratic Problem for Stochastic Linear Control Systems with Delay

Stochastic Optimal Linear Quadratic Regulation Control of Discrete-time Systems with Delay and Quadratic Constraints

Delayed Optimal Control of Stochastic LQ Problem.

Minimax Optimal Control of Uncertain Quasi-Integrable Hamiltonian Systems with Time-Delayed Bounded Feedback

Linear Quadratic Control for Multiple Time-Delayed Uncertain Random Systems

Recursive LQ Problem for Delay Systems Involving Continuous and Impulse Controls

Suboptimal Control of Linear Systems with State Time-Delay

Optimal Impulsive Control of Delay Systems Based on Partial Information

Weak Closed-loop Solvability of Linear Quadratic Stochastic Optimal Control Problems with Partial Information

Stochastic LQ Problem with Delayed Control

Optimal Control of Constrained Stochastic Linear-Quadratic Model with Applications

Optimal state-delay control in nonlinear dynamic systems

State feedback control for stochastic regular linear quadratic tracking problem with input time delay

Discrete‐time linear quadratic gaussian control with input delay and Markovian packet dropouts

Near-Optimal Control for Time-Varying Linear Discrete Systems with Additive Nonlinearities and Random Gains

Stochastic linear-quadratic optimal control problems with multi-dimensional state and non-Markovian regime switching

A class of optimal state-delay control problems