Abstract:This paper discusses the output-feedback-based model-free optimal output tracking control problem of discrete-time systems with completely unknown system models under mild assumptions. The only information that allows utilisation is the system output and the reference output. To overcome these challenges, the paper aims to solve a model-free optimal output regulation problem for achieving optimal output tracking control; solving an optimal output regulation problem is equivalent to solving a linear quadratic regulation (LQR) problem and a constrained static optimisation problem. The state reconstruction is first given to represent the system state in terms of the input and output sequences. A data-driven value iteration (VI) algorithm is then proposed to iteratively approximate the solution to the discrete-time algebraic Riccati equation (ARE) of the corresponding LQR problem on the basis of input and output data. Next, based on the iterative solutions with respect to the ARE, a model-free solution is provided for the corresponding constrained static optimisation problem. Finally, an alternative reference system equivalent to the original reference system is established to avoid the requirement of having the knowledge of the reference system dynamics and the reference state. A numerical example is employed to demonstrate the effectiveness of the proposed control scheme.

Adaptive Dynamic Programming-Based Robust Output Regulation of Discrete-Time Linear Systems via Output Feedback

Dynamic Output Feedback Stabilizing Control For Linear Time-Varying Uncertain Systems With Delayed State And Control

Decentralized Adaptive Output Regulation for a Class of Large-Scale Nonlinear Systems.

Output feedback stabilizing controller for linear time-varying uncertain systems with delayed state

Robust Output Feedback Control for a Class of Linear Time-Varying Uncertain Time-Delay Systems

Adaptive Dynamic Programming and Adaptive Optimal Output Regulation of Linear Systems

Robust Stabilization of Uncertain State-Delayed Systems Via Output Feedback

Optimal Output Tracking Control of Linear Discrete-Time Systems with Unknown Dynamics by Adaptive Dynamic Programming and Output Feedback

Robust ADP Design for Continuous-Time Nonlinear Systems with Output Constraints

Optimal Output Regulation for General Linear Systems Via Adaptive Dynamic Programming

Optimal Output Regulation for Unknown Continuous-Time Linear Systems by Internal Model and Adaptive Dynamic Programming

Robust Adaptive Output Feedback Control of Nonlinearly Parameterized Systems

Adaptive Optimal Discrete-Time Output-Feedback Using an Internal Model Principle and Adaptive Dynamic Programming

Adaptive optimal output regulation of linear discrete-time systems based on event-triggered output-feedback

ADP-based nonlinear optimal output regulation with nonlinear exosystem

Reinforcement Learning‐based Robust Optimal Output Regulation for Constrained Nonlinear Systems with Static and Dynamic Uncertainties

Discrete-Time Multivariable Robust Model Reference Adaptive Control Based On Kp=Lds Factorization: An Inputoutputapproach

Robust Optimal Output Regulation for Nonlinear Systems With Unknown Parameters

Adaptive Output-Feedback Optimal Control for Continuous-Time Linear Systems Based on Adaptive Dynamic Programming Approach

Optimal dynamic output feedback control of unknown linear continuous-time systems by adaptive dynamic programming

Robust Output Regulation For A Class Of Uncertain Nonlinear Systems