Abstract:A reinforcement learning (RL) based fault-tolerant control strategy is developed in this paper for wind turbine torque & pitch control under actuator & sensor faults subject to unknown system models. An incremental model-based heuristic dynamic programming (IHDP) approach, along with a critic-actor structure, is designed to enable fault-tolerance capability and achieve optimal control. Particularly, an incremental model is embedded in the critic-actor structure to quickly learn the potential system changes, such as faults, in real-time. Different from the current IHDP methods that need the intensive evaluation of the state and input matrices, only the input matrix of the incremental model is dynamically evaluated and updated by an online recursive least square estimation procedure in our proposed method. Such a design significantly enhances the online model evaluation efficiency and control performance, especially under faulty conditions. In addition, a value function and a target critic network are incorporated into the main critic-actor structure to improve our method’s learning effectiveness. Case studies for wind turbines under various working conditions are conducted based on the fatigue, aerodynamics, structures, and turbulence (FAST) simulator to demonstrate the proposed method’s solid fault-tolerance capability and adaptability. Note to Practitioners—This work achieves high-performance wind turbine control under unknown actuator & sensor faults. Such a task is still an open problem due to the complexity of turbine dynamics and potential uncertainties in practical situations. A novel data-driven and model-free control strategy based on reinforcement learning is proposed to handle these issues. The designed method can quickly capture the potential changes in the system and adjust its control policy in real-time, rendering strong adaptability and fault-tolerant abilities. It provides data-driven innovations for complex operational tasks of wind turbines and demonstrates the feasibility of applying reinforcement learning to handle fault-tolerant control problems. The proposed method has a generic structure and has the potential to be implemented in other renewable energy systems.

Intelligent Fault-Tolerant Active Power Control Using Reinforcement Learning for Offshore Wind Farms

Wind Turbine Fault-Tolerant Control via Incremental Model-Based Reinforcement Learning

Reactive Power Control of Grid-Connected Wind Farm Based on Adaptive Dynamic Programming.

Reactive-Voltage Coordinated Control of Offshore Wind Farm Based on Deep Reinforcement Learning

Fault-Tolerant Three-Vector Model-Predictive-Control-Based Grid-Connected Control Strategy for Offshore Wind Farms

A Novel Control Strategy For Offshore Dfig-Based Wind Farm Integrated Through Diode-Rectifier-Based Hvdc Transmission

An Improved Power Control Approach for Wind Turbine Fatigue Balancing in an Offshore Wind Farm

A Multiagent Reinforcement Learning Approach for Wind Farm Frequency Control

Reinforcement Learning-Based Multiobjective Control of Grid-Connected Wind Farms

Adaptive Fault-Tolerant Control of Wind Turbines With Guaranteed Transient Performance Considering Active Power Control of Wind Farms.

Distributed Optimization Control Schemes Applied on Offshore Wind Farm Active Power Regulation

Integrated analysis of hybrid control for offshore wind turbines: A case study in wave resonance prone wind farms

Model predictive control strategy in waked wind farms for optimal fatigue loads

Cooperative Wind Farm Control With Deep Reinforcement Learning and Knowledge-Assisted Learning

A Distributed Model Predictive Wind Farm Controller for Active Power Control

Integrating Large Wind Farms into Weak Power Grids with Long Transmission Lines

Active power control of wind farms: an instantaneous approach on waked conditions

Fault-Tolerant Control Implemented for Sustainable Active and Reactive Regulation of a Wind Energy Generation System

Jointly improving energy efficiency and smoothing power oscillations of integrated offshore wind and photovoltaic power: a deep reinforcement learning approach

On-Site Engineering Test of Active Support Control for the PV Station and Wind Farm in the AC-DC Hybrid Power Grid under Extreme Fault Conditions