Abstract:This paper develops a novel Adaptive Dynammic Programming based approach, in that the focus is on minimizing the consecutive changes in control inputs over a finite horizon to solve the optimal tracking problem for completely unknown discrete time systems. Through suitable system transformation, the optimal tracking problem is transformed to a regulation problem with respect to state tracking error. The latter leads to a novel performance index function over finite horizon and corresponding nonlinear HJB equation that is solved in an approximative iterative sense using a novel iterative ADP‐based algorithm. Adaptive dynamic programming (ADP) based approaches are effective for solving nonlinear Hamilton–Jacobi–Bellman (HJB) in an approximative sense. This paper develops a novel ADP‐based approach, in that the focus is on minimizing the consecutive changes in control inputs over a finite horizon to solve the optimal tracking problem for completely unknown discrete time systems. To that end, the cost function considers within its arguments: tracking performance, energy consumption and as a novelty, consecutive changes in the control inputs. Through suitable system transformation, the optimal tracking problem is transformed to a regulation problem with respect to state tracking error. The latter leads to a novel performance index function over finite horizon and corresponding nonlinear HJB equation that is solved in an approximative iterative sense using a novel iterative ADP‐based algorithm. A suitable Neural network‐based structure is proposed to learn the initial admissible one step zero control law. The proposed iterative ADP is implemented using heuristic dynamic programming technique based on actor‐critic Neural Network structure. Finally, simulation studies are presented to illustrate the effectiveness of the proposed algorithm.

ADP Based Optimal Tracking Control for a Class of Linear Discrete-Time System with Multiple Delays.

Time Delay System Tracking Control Based on ADP Iterative Algorithm

A Learning-Based Optimal Tracking Controller for Continuous Linear Systems with Unknown Dynamics: Theory and Case Study

Adaptive dynamic programming-based optimal control for nonlinear state constrained systems with input delay

Tracking Control with Multiple Input Delays for Continuous-Time Systems

Linear Quadratic Tracking Control of Unknown Discrete-Time Systems Using Value Iteration Algorithm

H ∞ Reference Tracking Control Design for a Class of Nonlinear Systems with Time-Varying Delays

OPTIMALI TRACKING CONTROL OF DISCRETE TIMEDELAY SYSTEMS AND ITS APPLICATION

Decentralized optimal tracking control for large-scale nonlinear systems with tracking error constraints

Approximation-based Adaptive Tracking Control of Pure-Feedback Nonlinear Systems with Multiple Unknown Time-Varying Delays.

Adaptive Trajectory Tracking for Linear Delay Systems with Application to Rotary Motors

Near optimal tracking control of a class of nonlinear systems and an experimental comparison

Robust Optimal Control For Time-Delay Systems With Dynamic Uncertainties Via Adp

Further Results on Optimal Tracking Control for Nonlinear Systems with Nonzero Equilibrium Via Adaptive Dynamic Programming

Finite‐Horizon Ε‐optimal Tracking Control of Discrete‐Time Linear Systems Using Iterative Approximate Dynamic Programming

Optimal Tracking Control Problem for Linear State and Control Time-Delay Systems

ADP-Based Online Tracking Control of Partially Uncertain Time-Delayed Nonlinear System and Application to Wheeled Mobile Robots.

Adaptive Tracking Control of Uncertain Nonlinear System with Time Delays, External Disturbances and Dead-Zone Input.

Robust Optimal Parallel Tracking Control Based on Adaptive Dynamic Programming

Model‐free optimal tracking over finite horizon using adaptive dynamic programming

Optimal Tracking Control for a Class of Unknown Discrete-time Systems with Actuator Saturation Via Data-based ADP Algorithm