Abstract:In this paper, a novel adaptive integral reinforcement learning (AIRL) is utilized to online handle the finite-horizon optimum control policies of the partially unknown multi-input nonlinear system. Firstly, the concept of Nash equilibrium is introduced to make the multiple cost functions reach the saddle point. Then, dual neural networks (NNs) are applied to approach the performance index functions based on the integral reinforcement signal. Simultaneously, two novel learning algorithms are proposed to update the NN weights, in which the convergence of weights is proved. Then, the optimal strategies can be obtained by using the obtained weights. The designed controllers based on the data-driven AIRL scheme can avoid the internal state of the system and the derivatives of NN activations in the weight learning process. Finally, the stability of the controlled system is analyzed. An F-16 aircraft model and another nonlinear system are utilized to prove the validity and rationality of the algorithm. Note to Practitioners —There exist many multi-input systems in practical engineering, which includes multi-engine driven F-16 aircraft, large radar servo system and large artillery systems, etc. The finite-horizon optimal control of these systems is crucial for the better performance of system state. However, an accurate engineering model is difficult to obtain, and the finite-horizon cannot generally be achieved. To address these issues, this paper proposes the finite-horizon optimal control for these systems based on a novel adaptive integral reinforcement learning (AIRL). The AIRL can realize an optimal performance for these multi-input systems in finite-time without internal system dynamics, which is a good development for the multi-input system in practical engineering.

Data-Driven Near-Optimal Control of Nonlinear Systems Over Finite Horizon

Optimal Control for Constrained Discrete-Time Nonlinear Systems Based on Safe Reinforcement Learning.

Learning-based optimal control of linear time-varying systems over large time intervals

Neural network-based finite-horizon optimal control of uncertain affine nonlinear discrete-time systems

Model-free Adaptive Dynamic Programming for Optimal Control of Discrete-time Affine Nonlinear System

Data-Based Self-Learning Optimal Control For Continuous-Time Unknown Nonlinear Systems With Disturbance

Reinforcement Learning for Adaptive Optimal Control of Unknown Continuous-Time Nonlinear Systems with Input Constraints.

Data-driven finite-horizon optimal tracking control scheme for completely unknown discrete-time nonlinear systems.

An Optimal Solution to Infinite Horizon Nonlinear Control Problems: Part II

Data-Driven Suboptimal Control for Nonlinear Systems Using State-Dependent Riccati Equation.

Data-Driven Nearly Optimal Control for Constrained Nonlinear Systems

Nearly Finite-Horizon Optimal Control for A Class of Nonaffine Time-Delay Nonlinear Systems Based on Adaptive Dynamic Programming

Nearly Finite-Horizon Optimal Control for Nonaffine Time-Delay Nonlinear Systems

Online adaptive learning of optimal control solutions using integral reinforcement learning

Finite-horizon Neural Optimal Tracking Control for a Class of Nonlinear Systems with Unknown Dynamics

Model-based reinforcement learning for infinite-horizon approximate optimal tracking

Data-Driven Control for Nonlinear Distributed Parameter Systems

Near-Optimal Control Without Solving HJB Equations and Its Applications

Robust Near-optimal Control for Constrained Nonlinear System via Integral Reinforcement Learning

Finite-Horizon Optimal Control for Nonlinear Multi-Input Systems with Online Adaptive Integral Reinforcement Learning

The Finite-Horizon Optimal Control for a Class of Time-Delay Affine Nonlinear System