Abstract:Highlights • New collective pitch control for wind turbines using reinforcement learning. • Uses the DDPG algorithm to train multiple agents at varied wind speeds. • Deploys fuzzy logic to fine-tune pitch control from trained agents. • Enhances wind turbine performance in technical and economic terms. • Achieves stabilized generator speed and maximized power output. Wind turbines (WTs) have highly nonlinear and uncertain dynamics due to aerodynamic complexity, mechanical factors, and fluctuations in wind conditions. Turbulence and wind shear add complexity to modelling, especially in constant power region (region 3). Thus, an effective control design demands a deep understanding of the nonlinearities and uncertainties. This paper suggests a novel model-free reinforcement learning (RL) collective pitch angle controller to operate efficiently in region 3. The proposed controller stabilizes generator speed, maximizes power output, and minimizes fluctuations while accommodating system uncertainties, nonlinearity, and pitch limits. The disparity between WT dynamics due to wind speed perturbations and uncertainties is measured using a gap-metric criterion. The controller design adopts a deep deterministic policy gradient (DDPG) algorithm to train six agents in a medium-fidelity WT environment at different mean wind speeds to ensure the controller's robustness. Initially, imitation learning is used for efficient sample collection to fasten training convergence. Afterwards, the agent learns by interacting with the environment. After the training, the pitch control outputs from multi-trained agents are processed by a fuzzy system to have smooth transitions under different operating conditions. The resulting fuzzy DDPG (F-DDPG) controller is deployed to obtain the optimal pitch control action. The performance of the proposed F-DDPG controller is compared to the gain-scheduled PI (GSPI), Linear-Quadratic-Regulator (LQR), and single-DDPG-agent controllers. The controllers are simulated in high-fidelity onshore and offshore 5-MW wind turbine environments using the OpenFAST/MATLAB simulation tools. The results reveal the superiority of the proposed F-DDPG controller in generalizing its optimal performance in different operating conditions.

Deep reinforcement learning for PMSG wind turbine control via twin delayed deep deterministic policy gradient (TD3)

Modeling and control of the wind turbine with the Direct Drive Permanent Magnet Generator integrated to power grid

Power Fluctuations Smoothing Control Based on PCH Model of D-PMSG Wind Power System

An Integrated Control Strategy for D-PMSG Wind Power Generation Systems

A novel control strategy of wind turbine MPPT implementation for direct-drive PMSG wind generation imitation platform

Application of Reinforcement Learning Algorithm to Parameter Identification for MPPT Control of PMSG Wind Energy Conversion Systems

Adaptive Dual-layer Sliding Mode Control for Wind Turbines with Estimated Wind Speed

Nonlinear Model Predictive Control for Doubly Fed Induction Generator with Uncertainties

Vector Control of PMSM Using TD3 Reinforcement Learning Algorithm

A Survey on Model Predictive Control of DFIGs in Wind Energy Conversion Systems

Improved load-adaptive control strategy for PMSG based stand-alone wind energy generation system

Sensorless Control of PMSG for Wind Turbines Based on the On-Line Parameter Identification

A novel control strategy of direct-drive pmsg wind generation mppt based on experimental imitation platform

MPPT control for PMSG based wind turbine: Adaptive dynamic programming approach

Fuzzy-Based Collective Pitch Control for Wind Turbine via Deep Reinforcement Learning

Reinforcement learning to maximize wind turbine energy generation

Twin-Delayed Deep Deterministic Policy Gradient Algorithm to Control a Boost Converter in a DC Microgrid

Reinforcement learning to maximise wind turbine energy generation

Robust Predictive Control for Direct-Driven Surface-Mounted Permanent-Magnet Synchronous Generators Without Mechanical Sensors

A Novel Adaptive Model Predictive Control Strategy for DFIG Wind Turbine with Parameter Variations in Complex Power Systems