Abstract:This paper develops a novel Adaptive Dynammic Programming based approach, in that the focus is on minimizing the consecutive changes in control inputs over a finite horizon to solve the optimal tracking problem for completely unknown discrete time systems. Through suitable system transformation, the optimal tracking problem is transformed to a regulation problem with respect to state tracking error. The latter leads to a novel performance index function over finite horizon and corresponding nonlinear HJB equation that is solved in an approximative iterative sense using a novel iterative ADP‐based algorithm. Adaptive dynamic programming (ADP) based approaches are effective for solving nonlinear Hamilton–Jacobi–Bellman (HJB) in an approximative sense. This paper develops a novel ADP‐based approach, in that the focus is on minimizing the consecutive changes in control inputs over a finite horizon to solve the optimal tracking problem for completely unknown discrete time systems. To that end, the cost function considers within its arguments: tracking performance, energy consumption and as a novelty, consecutive changes in the control inputs. Through suitable system transformation, the optimal tracking problem is transformed to a regulation problem with respect to state tracking error. The latter leads to a novel performance index function over finite horizon and corresponding nonlinear HJB equation that is solved in an approximative iterative sense using a novel iterative ADP‐based algorithm. A suitable Neural network‐based structure is proposed to learn the initial admissible one step zero control law. The proposed iterative ADP is implemented using heuristic dynamic programming technique based on actor‐critic Neural Network structure. Finally, simulation studies are presented to illustrate the effectiveness of the proposed algorithm.

Optimal Tracking Control for a Class of Discrete-Time Nonlinear Systems Based on Ε-Adp

A Learning-Based Optimal Tracking Controller for Continuous Linear Systems with Unknown Dynamics: Theory and Case Study

Adaptive Extended State Space Predictive Control for a Kind of Nonlinear Systems.

Near optimal tracking control of a class of nonlinear systems and an experimental comparison

Model‐free optimal tracking over finite horizon using adaptive dynamic programming

Near-Optimal Tracking Control of Partially Unknown Discrete-Time Nonlinear Systems Based on Radial Basis Function Neural Network

Single‐network ADP for solving optimal event‐triggered tracking control problem of completely unknown nonlinear systems

Adaptive critic-based tracking control of non-affine nonlinear discrete-time systems with unknown dynamics

Robust Optimal Parallel Tracking Control Based on Adaptive Dynamic Programming

Optimal tracking control for unknown nonlinear systems with uncertain input saturation: A dynamic event-triggered ADP algorithm

Asymptotic Tracking Controller Design for Nonlinear Systems with Guaranteed Performance.

H ∞ Reference Tracking Control Design for a Class of Nonlinear Systems with Time-Varying Delays

${\Rm H}_{\infty}$ Output Tracking Control of Discrete-Time Nonlinear Systems Via Standard Neural Network Models

Functional cast-bracing for Colles' fractures. A comparison between cast-bracing and conventional plaster casts.

Integral sliding mode‐based event‐triggered nearly optimal tracking control for uncertain nonlinear systems

Adaptive dynamic programming-based optimal control for nonlinear state constrained systems with input delay

Time Delay System Tracking Control Based on ADP Iterative Algorithm

Experience replay based online adaptive robust tracking control for partially unknown nonlinear systems with asymmetric constrained‐input

Event-Triggered Optimal Tracking Control Design with DHP Formulation for Discrete-Time Nonlinear Nonzero-Sum Games

Parallel control for optimal tracking via adaptive dynamic programming

Robust Adaptive Inverse Optimal Tracking for Strict-Feedback Nonlinear Systems