Abstract:A reinforcement learning (RL) based fault-tolerant control strategy is developed in this paper for wind turbine torque & pitch control under actuator & sensor faults subject to unknown system models. An incremental model-based heuristic dynamic programming (IHDP) approach, along with a critic-actor structure, is designed to enable fault-tolerance capability and achieve optimal control. Particularly, an incremental model is embedded in the critic-actor structure to quickly learn the potential system changes, such as faults, in real-time. Different from the current IHDP methods that need the intensive evaluation of the state and input matrices, only the input matrix of the incremental model is dynamically evaluated and updated by an online recursive least square estimation procedure in our proposed method. Such a design significantly enhances the online model evaluation efficiency and control performance, especially under faulty conditions. In addition, a value function and a target critic network are incorporated into the main critic-actor structure to improve our method’s learning effectiveness. Case studies for wind turbines under various working conditions are conducted based on the fatigue, aerodynamics, structures, and turbulence (FAST) simulator to demonstrate the proposed method’s solid fault-tolerance capability and adaptability. Note to Practitioners—This work achieves high-performance wind turbine control under unknown actuator & sensor faults. Such a task is still an open problem due to the complexity of turbine dynamics and potential uncertainties in practical situations. A novel data-driven and model-free control strategy based on reinforcement learning is proposed to handle these issues. The designed method can quickly capture the potential changes in the system and adjust its control policy in real-time, rendering strong adaptability and fault-tolerant abilities. It provides data-driven innovations for complex operational tasks of wind turbines and demonstrates the feasibility of applying reinforcement learning to handle fault-tolerant control problems. The proposed method has a generic structure and has the potential to be implemented in other renewable energy systems.

Reinforcement Learning Controller for Variable-Speedwind Energy Conversion Systems

Nonlinear Adaptive Power Capture Control Of Variable-Speed Wind Energy Conversion Systems Using Online Approximators

Adaptive power acquisition control of variable-speed wind energy conversion systems under inaccurate wind speed measurement

L1 Adaptive Pitch Angle Controller of Wind Energy Conversion Systems.

Adaptive Dual-layer Sliding Mode Control for Wind Turbines with Estimated Wind Speed

Adaptive Continuous Neural Pitch Angle Control for Variable‐Speed Wind Turbines

Inverse Optimal Adaptive Neural Power Regulation Control for Variable-Speed Wind Turbines with Load Mitigation

Adaptive control of variable-speed wind energy conversion systems with inaccurate wind speed measurement

Adaptive power capture control of variable-speed wind energy conversion systems with guaranteed transient and steady-state performance

Effective Wind Speed Estimation Based Maximum Power Point Tracking Control for Variable-Speed Wind Turbine

Design of a Unified Power Controller for Variable-Speed Fixed-Pitch Wind Energy Conversion System

Reinforcement learning to maximize wind turbine energy generation

Effective Wind Speed Estimation and Prediction Based Feedforward Feedback Pitch Control for Wind Turbines.

Supervisory Control of a Wind Energy System by Using a Hybrid System Approach

Fixed- Time Adaptive Neural Pitch Angle Control for Variable-Speed Wind Turbines

Hybrid Intelligent Feedforward-Feedback Pitch Control for VSWT with Predicted Wind Speed

Reinforcement learning to maximise wind turbine energy generation

Passivity-based Robust Controller Design for a Variable Speed Wind Energy Conversion System

Multi-objective Performance Enhancement of Offshore Wind Turbines Through Planning Controller Parameter: A ‘Plan-Control’ Hierarchical Controller

Adaptive Neuro-Fuzzy Inference System-Based Maximum Power Tracking Controller for Variable Speed WECS

Wind Turbine Fault-Tolerant Control via Incremental Model-Based Reinforcement Learning