Abstract:This paper develops a novel Adaptive Dynammic Programming based approach, in that the focus is on minimizing the consecutive changes in control inputs over a finite horizon to solve the optimal tracking problem for completely unknown discrete time systems. Through suitable system transformation, the optimal tracking problem is transformed to a regulation problem with respect to state tracking error. The latter leads to a novel performance index function over finite horizon and corresponding nonlinear HJB equation that is solved in an approximative iterative sense using a novel iterative ADP‐based algorithm. Adaptive dynamic programming (ADP) based approaches are effective for solving nonlinear Hamilton–Jacobi–Bellman (HJB) in an approximative sense. This paper develops a novel ADP‐based approach, in that the focus is on minimizing the consecutive changes in control inputs over a finite horizon to solve the optimal tracking problem for completely unknown discrete time systems. To that end, the cost function considers within its arguments: tracking performance, energy consumption and as a novelty, consecutive changes in the control inputs. Through suitable system transformation, the optimal tracking problem is transformed to a regulation problem with respect to state tracking error. The latter leads to a novel performance index function over finite horizon and corresponding nonlinear HJB equation that is solved in an approximative iterative sense using a novel iterative ADP‐based algorithm. A suitable Neural network‐based structure is proposed to learn the initial admissible one step zero control law. The proposed iterative ADP is implemented using heuristic dynamic programming technique based on actor‐critic Neural Network structure. Finally, simulation studies are presented to illustrate the effectiveness of the proposed algorithm.

Near optimal tracking control of a class of nonlinear systems and an experimental comparison

A Learning-Based Optimal Tracking Controller for Continuous Linear Systems with Unknown Dynamics: Theory and Case Study

Near-Optimal Tracking Control of Partially Unknown Discrete-Time Nonlinear Systems Based on Radial Basis Function Neural Network

Further Results on Optimal Tracking Control for Nonlinear Systems with Nonzero Equilibrium Via Adaptive Dynamic Programming

Robust Optimal Parallel Tracking Control Based on Adaptive Dynamic Programming

Decentralized optimal tracking control for large-scale nonlinear systems with tracking error constraints

Robust Neurooptimal Control for a Robot Via Adaptive Dynamic Programming

Adaptive critic-based tracking control of non-affine nonlinear discrete-time systems with unknown dynamics

ADP-Based Robust Tracking Control for a Class of Nonlinear Systems With Unmatched Uncertainties

NN Adaptive Optimal Tracking Control for a Class of Uncertain Nonstrict Feedback Nonlinear Systems

Adaptive Optimal Tracking Control of Unknown Nonlinear Systems Using System Augmentation.

Model‐free optimal tracking over finite horizon using adaptive dynamic programming

Finite‐Horizon Ε‐optimal Tracking Control of Discrete‐Time Linear Systems Using Iterative Approximate Dynamic Programming

Finite-horizon Neural Optimal Tracking Control for a Class of Nonlinear Systems with Unknown Dynamics

Data-based Optimal Tracking of Autonomous Nonlinear Switching Systems.

Parallel control for optimal tracking via adaptive dynamic programming

Optimal tracking control for unknown nonlinear systems with uncertain input saturation: A dynamic event-triggered ADP algorithm

Optimal Tracking Control for Autonomous Vehicle with Prescribed Performance Via Adaptive Dynamic Programming

Adaptive dynamic programming-based optimal control for nonlinear state constrained systems with input delay

Nonlinear Optimal Control for Robot Manipulator Trajectory Tracking

Integral sliding mode‐based event‐triggered nearly optimal tracking control for uncertain nonlinear systems