Abstract:In this paper, a novel adaptive integral reinforcement learning (AIRL) is utilized to online handle the finite-horizon optimum control policies of the partially unknown multi-input nonlinear system. Firstly, the concept of Nash equilibrium is introduced to make the multiple cost functions reach the saddle point. Then, dual neural networks (NNs) are applied to approach the performance index functions based on the integral reinforcement signal. Simultaneously, two novel learning algorithms are proposed to update the NN weights, in which the convergence of weights is proved. Then, the optimal strategies can be obtained by using the obtained weights. The designed controllers based on the data-driven AIRL scheme can avoid the internal state of the system and the derivatives of NN activations in the weight learning process. Finally, the stability of the controlled system is analyzed. An F-16 aircraft model and another nonlinear system are utilized to prove the validity and rationality of the algorithm. Note to Practitioners —There exist many multi-input systems in practical engineering, which includes multi-engine driven F-16 aircraft, large radar servo system and large artillery systems, etc. The finite-horizon optimal control of these systems is crucial for the better performance of system state. However, an accurate engineering model is difficult to obtain, and the finite-horizon cannot generally be achieved. To address these issues, this paper proposes the finite-horizon optimal control for these systems based on a novel adaptive integral reinforcement learning (AIRL). The AIRL can realize an optimal performance for these multi-input systems in finite-time without internal system dynamics, which is a good development for the multi-input system in practical engineering.

Adaptive Optimal Control For A Class Of Uncertain Systems With Saturating Actuators And External Disturbance Using Integral Reinforcement Learning

Robust Adaptive Control of Uncertain Nonlinear Systems in the Presence of Input Saturation and External Disturbance.

Synchronous Optimal Control Method for Nonlinear Systems with Saturating Actuators and Unknown Dynamics Using Off-Policy Integral Reinforcement Learning

Robust Near-optimal Control for Constrained Nonlinear System via Integral Reinforcement Learning

Neural-Network-Based Online Optimal Control for Uncertain Non-Linear Continuous-Time Systems with Control Constraints

Neuro-Optimal Control of Unknown Nonaffine Nonlinear Systems with Saturating Actuators.

Online adaptive data-driven control for unknown nonlinear systems with constrained-input

Robust optimal control of the multi‐input systems with unknown disturbance based on adaptive integral reinforcement learning Q‐function

Adaptive Reinforcement Learning Neural Network Control for Uncertain Nonlinear System With Input Saturation.

Data-based neural controls for an unknown continuous-time multi-input system with integral reinforcement

Finite-Horizon Optimal Control for Nonlinear Multi-Input Systems with Online Adaptive Integral Reinforcement Learning

Reinforcement Learning for Adaptive Optimal Control of Unknown Continuous-Time Nonlinear Systems with Input Constraints.

Finite-Horizon $H_{\infty }$ Tracking Control for Unknown Nonlinear Systems With Saturating Actuators.

Reinforcement learning for robust stabilization of nonlinear systems with asymmetric saturating actuators

Event-triggered-based Online Integral Reinforcement Learning for Optimal Control of Unknown Constrained Nonlinear Systems.

Integral Reinforcement Learning-Based Guaranteed Cost Control for Unknown Nonlinear Systems Subject to Input Constraints and Uncertainties.

Optimal Robust Control of Nonlinear Uncertain System Via Off-Policy Integral Reinforcement Learning

Online adaptive learning of optimal control solutions using integral reinforcement learning

Fixed-Time Neuro-Optimal Adaptive Control With Input Saturation for Uncertain Robots

Data-based Robust Adaptive Control for a Class of Unknown Nonlinear Constrained-Input Systems Via Integral Reinforcement Learning

Reinforcement Learning for Robust Adaptive Control of Partially Unknown Nonlinear Systems Subject to Unmatched Uncertainties