Abstract:This paper discusses the output-feedback-based model-free optimal output tracking control problem of discrete-time systems with completely unknown system models under mild assumptions. The only information that allows utilisation is the system output and the reference output. To overcome these challenges, the paper aims to solve a model-free optimal output regulation problem for achieving optimal output tracking control; solving an optimal output regulation problem is equivalent to solving a linear quadratic regulation (LQR) problem and a constrained static optimisation problem. The state reconstruction is first given to represent the system state in terms of the input and output sequences. A data-driven value iteration (VI) algorithm is then proposed to iteratively approximate the solution to the discrete-time algebraic Riccati equation (ARE) of the corresponding LQR problem on the basis of input and output data. Next, based on the iterative solutions with respect to the ARE, a model-free solution is provided for the corresponding constrained static optimisation problem. Finally, an alternative reference system equivalent to the original reference system is established to avoid the requirement of having the knowledge of the reference system dynamics and the reference state. A numerical example is employed to demonstrate the effectiveness of the proposed control scheme.

Optimal Output Tracking Control of Linear Discrete-Time Systems with Unknown Dynamics by Adaptive Dynamic Programming and Output Feedback

A Learning-Based Optimal Tracking Controller for Continuous Linear Systems with Unknown Dynamics: Theory and Case Study

Adaptive Output-Feedback Control of Nonlinear Systems with Unknown Nonlinearities.

Output Feedback Adaptive Robust Learning Control of a Class of Nonlinear Systems with Periodic Disturbances

Robust Output Regulation and Reinforcement Learning-Based Output Tracking Design for Unknown Linear Discrete-Time Systems

The Adaptive Optimal Output Feedback Tracking Control of Unknown Discrete-Time Linear Systems Using a Multistep Q-Learning Approach

Operational Optimal Tracking Control for Industrial Multirate Systems Subject to Unknown Disturbances

Optimal dynamic output feedback control of unknown linear continuous-time systems by adaptive dynamic programming

Adaptive Dynamic Programming and Adaptive Optimal Output Regulation of Linear Systems

Robust Optimal Output Regulation for Nonlinear Systems With Unknown Parameters

An Information-state based Approach to the Optimal Output Feedback Control of Nonlinear Systems

Near Optimal Neural Network-based Output Feedback Control of Affine Nonlinear Discrete-Time Systems

Additive-Decomposition-Based Output Feedback Tracking Control for Systems with Measurable Nonlinearities and Unknown Disturbances

Optimal Output Regulation for General Linear Systems Via Adaptive Dynamic Programming

Output Feedback Tracking Control for Nonlinear Time-Delay Systems with Tracking Errors and Input Constraints

Output Feedback Adaptive Dynamic Programming for Linear H∞ Tracking Control

Adaptive Optimal Discrete-Time Output-Feedback Using an Internal Model Principle and Adaptive Dynamic Programming

Global Output-Feedback Prescribed Performance Control of Nonlinear Systems With Unknown Virtual Control Coefficients

Robust Tracking Control of Unknown Nonlinear Systems With Discontinuous References Under Output Constraints

Finite-horizon Neural Optimal Tracking Control for a Class of Nonlinear Systems with Unknown Dynamics

Linear Quadratic Tracking Control of Unknown Discrete-Time Systems Using Value Iteration Algorithm