Abstract:This paper develops a novel Adaptive Dynammic Programming based approach, in that the focus is on minimizing the consecutive changes in control inputs over a finite horizon to solve the optimal tracking problem for completely unknown discrete time systems. Through suitable system transformation, the optimal tracking problem is transformed to a regulation problem with respect to state tracking error. The latter leads to a novel performance index function over finite horizon and corresponding nonlinear HJB equation that is solved in an approximative iterative sense using a novel iterative ADP‐based algorithm. Adaptive dynamic programming (ADP) based approaches are effective for solving nonlinear Hamilton–Jacobi–Bellman (HJB) in an approximative sense. This paper develops a novel ADP‐based approach, in that the focus is on minimizing the consecutive changes in control inputs over a finite horizon to solve the optimal tracking problem for completely unknown discrete time systems. To that end, the cost function considers within its arguments: tracking performance, energy consumption and as a novelty, consecutive changes in the control inputs. Through suitable system transformation, the optimal tracking problem is transformed to a regulation problem with respect to state tracking error. The latter leads to a novel performance index function over finite horizon and corresponding nonlinear HJB equation that is solved in an approximative iterative sense using a novel iterative ADP‐based algorithm. A suitable Neural network‐based structure is proposed to learn the initial admissible one step zero control law. The proposed iterative ADP is implemented using heuristic dynamic programming technique based on actor‐critic Neural Network structure. Finally, simulation studies are presented to illustrate the effectiveness of the proposed algorithm.

Model‐Free H∞ Control Design for Unknown Continuous‐Time Linear System Using Adaptive Dynamic Programming

A nonlinear predictive control algorithm based on fuzzy online modeling and discrete optimization

Model-Free Adaptive Optimal Control for Unknown Nonlinear Multiplayer Nonzero-Sum Game

Model-free Adaptive Dynamic Programming for Optimal Control of Discrete-time Affine Nonlinear System

H∞$$ {h}_{\infty } $$ Optimal Output Tracking Control for Markov Jump Systems: A Reinforcement Learning‐based Approach

H ∞ Reference Tracking Control Design for a Class of Nonlinear Systems with Time-Varying Delays

AsynchronousH∞control of Semi-Markov Jump Linear Systems

H ∞ optimal control of unknown linear systems by adaptive dynamic programming with applications to time‐delay systems

Online Adaptive Optimal Control for Continuous-Time Nonlinear Systems with Completely Unknown Dynamics.

Robust ADP Design for Continuous-Time Nonlinear Systems with Output Constraints

Model‐free optimal tracking over finite horizon using adaptive dynamic programming

Robust Approximate Dynamic Programming for Nonlinear Systems With Both Model Error and External Disturbance

&Lt;inline-Formula> &Lt;tex-Math Notation="latex">$\mathcal H_{\infty }$&Lt;/tex-Math> &Lt;/inline-Formula> Control for 2-D Markov Jump Systems in Roesser Model

An efficient model‐free adaptive optimal control of continuous‐time nonlinear non‐zero‐sum games based on integral reinforcement learning with exploration

Data-Driven Tracking Control With Adaptive Dynamic Programming for a Class of Continuous-Time Nonlinear Systems

Min–max adaptive dynamic programming for zero-sum differential games

Adaptive Dynamic Programming for a Nonlinear Two‐Player Non‐Zero‐Sum Differential Game With State and Input Constraints

Learning-Based Nonlinear $H^\infty$ Control via Game-Theoretic Differential Dynamic Programming

H∞ Tracking Control for Linear Discrete-Time Systems: Model-Free Q-Learning Designs

Event-Triggered Single-Network ADP for Zero-Sum Game of Unknown Nonlinear Systems with Constrained Input