Abstract:SummaryIn this paper, the adaptive optimal regulator design for unknown quantized linear discrete‐time control systems over fixed finite time is introduced. First, to mitigate the quantization error from input and state quantization, dynamic quantizer with time‐varying step‐size is utilized wherein it is shown that the quantization error will decrease overtime thus overcoming the drawback of the traditional uniform quantizer. Next, to relax the knowledge of system dynamics and achieve optimality, the adaptive dynamic programming methodology is adopted under Bellman's principle by using quantized state and input vector. Because of the time‐dependency nature of finite horizon, an adaptive online estimator, which learns a newly defined time‐varying action‐dependent value function, is updated at each time step so that policy and/or value iterations are not needed. Further, an additional error term corresponding to the terminal constraint is defined and minimized along the system trajectory. The proposed design scheme yields a forward‐in‐time and online scheme, which enjoys great practical merits. Lyapunov analysis is used to show the boundedness of the closed‐loop system; whereas when the time horizon is stretched to infinity as in the case of infinite horizon, asymptotic stability of the closed‐loop system is demonstrated. Simulation results on a benchmarking batch reactor system are included to verify the theoretical claims. The net result is the design of the optimal adaptive controller for uncertain quantized linear discrete‐time systems in a forward‐in‐time manner. Copyright © 2014 John Wiley & Sons, Ltd.

Optimal Controller and Quantizer Selection for Partially Observable Linear-Quadratic-Gaussian Systems

Optimal Controller Synthesis and Dynamic Quantizer Switching for Linear-Quadratic-Gaussian Systems

Optimal quantized feedback control for linear quandratic Gaussian systems with input delay

Optimal Input and Quantization Interval for Quantized Feedback System With Variable Quantizer

Inverse Optimal Adaptive Fuzzy Output Feedback Control for Nonlinear Systems with Output Quantization

Network-Based Quantized Control for Fuzzy Singularly Perturbed Semi-Markov Jump Systems and Its Application.

A New Adaptive Control Scheme for Uncertain Nonlinear Systems with Quantized Input Signal

Linear Quadratic Gaussian Control with Quantised Innovations Kalman Filter over a Symmetric Channel

Robust Optimization for Quantum Reinforcement Learning Control Using Partial Observations

Observer-Based Control for Piecewise-Affine Systems with Both Input and Output Quantization.

On Stochastic Optimal Control of Partially Observable Nonlinear Quasi Hamiltonian Systems

Adaptive Output Feedback Control of Stochastic Systems with Mismatched Uncertainties Input-Output Quantization

Command Filter-Based Adaptive Optimal Control of Uncertain Nonlinear Systems with Quantized Input

Data-Driven Control of Linear Systems via Quantized Feedback

Approximate Optimal Control over Unreliable Communication Channels

Robust H∞ control with partly quantized information

Robust H∞ Output Tracking Control with Partly Quantized Information

Robust ℋ∞ Output Feedback Control of Discrete-Time Networked Systems with Adaptive Quantizers.

Quantized Control for Uncertain Singular Markovian Jump Linear Systems with General Incomplete Transition Rates

Robust H ∞ Output Feedback Control with Partly Quantised Information

Optimal Control of Uncertain Quantized Linear Discrete‐time Systems