Abstract:Since the existence of fractional order dynamics, it is difficult to obtain an optimality equation to solve for fractional-order optimal control. In this paper, a fractional Hamilton-Jacobi-Bellman (HJB) equation based on error derivative is proposed, and a corresponding online learning algorithm is designed. The scheme can handle the optimal tracking problem for the $0<\alpha\leq1$ order nonlinear systems. Since the traditional quadratic cost function is unbounded at infinite time and the optimal control derived from the discounted cost function fails to stabilize the system asymptotically, a cost function based on the error derivative is proposed, which can avoid these problems, and the system is not restricted to be zero equilibrium. Then, the fractional HJB equation is derived by constructing an auxiliary signal without directly using the chain rule of differentiation. The optimality, stability and convergence of its solution are proved, and actor-critic neural networks (NNs) are established to perform the RL algorithm. Finally, the algorithm is applied to a chaotic magnetic-field electromechanical transducer (MFET) system to verify the effectiveness and advantages Note to Practitioners—In engineering, fractional-order dynamics properties are used in many practical systems such as chaotic MFET systems, chaotic arch micro-electro-mechanical systems and fractional order resonant controllers, etc. For these fractional-order systems, traditional integer-order control methods cannot be applied. Moreover, optimal performance with minimal cost/resources can be achieved through optimal control. Therefore, a intelligent control method based on reinforcement learning is proposed in this paper to realize the optimal control for fractional-order systems. The proposed method is applicable to most fractional-order systems and can achieve stable control while optimizing the objective performance and reducing energy consumption. Finally, the proposed algorithm is successfully applied to the chaotic MFET systems.

Adaptive Neural Optimal Backstepping Control of Uncertain Fractional-Order Chaotic Circuit Systems Via Reinforcement Learning

Nonlinear Control and Circuit Implementation in Coupled Nonidentical Fractional-Order Chaotic Systems

Fractional-Order Systems Optimal Control via Actor-Critic Reinforcement Learning and Its Validation for Chaotic MFET

Adaptive Inverse Optimal Control of a Novel Fractional-Order Four-Wing Hyperchaotic System with Uncertain Parameter and Circuitry Implementation

Adaptive fuzzy echo state network optimal synchronization control of hybrid–order chaotic systems via reinforcement learning

Synchronization for a Class of Fractional Order Chaotic Systems with Uncertainties Via Fractional Backstepping

Reinforcement Learning-Based Control for Nonlinear Discrete-Time Systems with Unknown Control Directions and Control Constraints

Unified Neuroadaptive Fault-Tolerant Control of Fractional-Order Systems with or Without State Constraints

Neural Network Command Filtered Control of Fractional-Order Chaotic Systems

Adaptive fuzzy finite-time PID backstepping control for chaotic systems with full states constraints and unmodeled dynamics

Adaptive Fuzzy Echo State Network Control of Fractional-Order Large-Scale Nonlinear Systems With Time-Varying Deferred Constraints

Adaptive Backstepping Control for Fractional-Order Nonlinear Systems with External Disturbance and Uncertain Parameters Using Smooth Control

Adaptive Neural Network Backstepping Control of Fractional-Order Nonlinear Systems With Actuator Faults

Event-triggered adaptive neural control of fractional-order nonlinear systems with full-state constraints

Neuro-Fuzzy-Based Adaptive Dynamic Surface Control for Fractional-Order Nonlinear Strict-Feedback Systems with Input Constraint

Nonlinear Filter-Based Adaptive Output-Feedback Control for Uncertain Fractional-Order Nonlinear Systems with Unknown External Disturbance

Adaptive Backstepping Output Feedback Control for A Class of Nonlinear Fractional Order Systems

Synchronisation of Uncertain Chaotic Systems Via Fuzzy-Regulated Adaptive Optimal Control Approach

Command Filtered Adaptive Backstepping Fuzzy Synchronization Control of Uncertain Fractional Order Chaotic Systems with External Disturbance

NN Reinforcement Learning Adaptive Control for a Class of Nonstrict-Feedback Discrete-Time Systems

A Novel Self-Learning Optimal Control Approach for Decentralized Guaranteed Cost Control of A Class of Complex Nonlinear Systems