Abstract:This paper discusses the output-feedback-based model-free optimal output tracking control problem of discrete-time systems with completely unknown system models under mild assumptions. The only information that allows utilisation is the system output and the reference output. To overcome these challenges, the paper aims to solve a model-free optimal output regulation problem for achieving optimal output tracking control; solving an optimal output regulation problem is equivalent to solving a linear quadratic regulation (LQR) problem and a constrained static optimisation problem. The state reconstruction is first given to represent the system state in terms of the input and output sequences. A data-driven value iteration (VI) algorithm is then proposed to iteratively approximate the solution to the discrete-time algebraic Riccati equation (ARE) of the corresponding LQR problem on the basis of input and output data. Next, based on the iterative solutions with respect to the ARE, a model-free solution is provided for the corresponding constrained static optimisation problem. Finally, an alternative reference system equivalent to the original reference system is established to avoid the requirement of having the knowledge of the reference system dynamics and the reference state. A numerical example is employed to demonstrate the effectiveness of the proposed control scheme.

Learning-based Event-triggered Adaptive Optimal Output Regulation of Linear Discrete-time Systems

Event-triggered Output Feedback Control for a Class of Discrete-Time Nonlinear Systems

Decentralized Adaptive Output Regulation for a Class of Large-Scale Nonlinear Systems.

Adaptive optimal output regulation of linear discrete-time systems based on event-triggered output-feedback

A Method for Adaptive Hybrid Output Regulation of Linear Systems

Adaptive Dynamic Programming and Adaptive Optimal Output Regulation of Linear Systems

Value iteration and adaptive optimal output regulation with assured convergence rate

Combining Data-Driven and Event-Driven for Online Learning Predictive Control in Power Converters

Event-Triggered Robust Adaptive Dynamic Programming with Output Feedback for Large-Scale Systems.

Optimal Output Regulation for Unknown Continuous-Time Linear Systems by Internal Model and Adaptive Dynamic Programming

Adaptive Optimal Output Regulation of Interconnected Singularly Perturbed Systems with Application to Power Systems

Output-feedback Robust Tracking Control of Uncertain Systems via Adaptive Learning

Output Regulation for Switched Systems: an Event-Triggered Model Predictive Control Approach

Optimal Output Regulation of Linear Discrete-Time Systems with Unknown Dynamics Using Reinforcement Learning

Model-Free Optimal Output Regulation for Linear Discrete-Time Lossy Networked Control Systems

Event-Triggered Controller Via Adaptive Output-Feedback For A Class Of Uncertain Nonlinear Systems

Optimal Output Tracking Control of Linear Discrete-Time Systems with Unknown Dynamics by Adaptive Dynamic Programming and Output Feedback

Optimal Output Regulation for General Linear Systems Via Adaptive Dynamic Programming

New Results in Cooperative Adaptive Optimal Output Regulation

Incremental Reinforcement Learning and Optimal Output Regulation under Unmeasurable Disturbances

Data-driven optimal output regulation for unknown linear discrete-time systems based on parameterization approach