Abstract:In this paper, both the finite-horizon and infinite-horizon stochastic control problems for multiplicative-noise discrete-time systems with input delay are investigated. The novelty contributions of the paper are twofold. First, a sufficient and necessary unique existing condition for the optimal control is obtained. The optimal controller is the feedback of the conditional expectation of the state. The feedback gain is computed with the solution to Riccati-type difference equation. Second, a stabilizing controller which minimizes the infinite-horizon performance index is derived by showing the convergence of the finite-horizon controller. It is worth emphasizing that under the exact observability, the system is stabilizable in the mean-square sense if and only if the algebraic Riccati-type equation have unique solution such that the specified matrix equation is positive definite. The key techniques developed are the establishing of the nonhomogeneous relationship between the state and the costate and the introduction of the specified Lyapunov function, which originates from the results of the finite-horizon optimal control. Moreover, the optimal controller is actually the `Smith Predictor' in time domain for discrete-time stochastic multiplicative-noise delay systems which is new to the best of our knowledge.

Exact Controllability of Discrete-Time Stochastic System with Multiplicative Noise

Exact controllability of forward and backward stochastic difference system

On Exact Controllability of Itô Stochastic Systems with Input Delay.

Impulsive Control of Stochastic Systems with Applications in Chaos Control, Chaos Synchronization, and Neural Networks

Stochastic Control for Discrete-Time Systems with Input Delay.

Relative Controllability of Stochastic Nonlinear Systems with Delay in Control

Asynchronous Control for Discrete-Time Markovian Jump Systems with Multiplicative Noise

Controllability of Stochastic Differential Equations with Markovian Switching

ON CONTROLLABILITY FOR STOCHASTIC CONTROL SYSTEMS WHEN THE COEFFICIENT IS TIME-VARIANT

The Controllability For A Kind Of Nonlinear Stochastic Control Systems Which The Coefficient Is Time-Dependent

Complete Controllability of Impulsive Stochastic Integro-Differential Systems.

Exact Controllability for Stochastic Transport Equations

Controllability on a Class of Switched Time-Varying Systems with Impulses and Multiple Time Delays

Approximate Controllability of Abstract Stochastic Impulsive Systems with Multiple Time‐varying Delays

Exact Controllability for a Refined Stochastic Wave Equation

Stabilization of Discrete-Time Multiplicative-Noise System Under Decentralized Controllers

Exact Controllability of Rational Expectations Model with Multiplicative Noise and Input Delay

Control theory for stochastic distributed parameter systems, an engineering perspective

Partial Approximate Controllability for Linear Stochastic Control Systems

Approximate Controllability of Stochastic Impulsive Systems with Control-Dependent Coefficients

Exponential Stabilization for Ito Stochastic Systems with Multiple Input Delays