Abstract:The high system complexity and strong wake effects bring significant challenges to wind farm operations. Conventional wind farm control methods may lead to degraded power generation efficiency. A reinforcement learning (RL)-based approach is proposed in this article to handle these issues, which can increase the long-term farm-level power generation subject to strong wake effects while without requiring analytical wind farm models. The proposed method is significantly distinct from existing RL-based wind farm control approaches, whose computational complexities usually increase heavily with the increase of total turbine numbers. In contrast, our method can greatly reduce training loads and enhance learning efficiency via two novel designs: first, automatic grouping and second, multiagent-based transfer learning (MATL). Automatic grouping can divide a large wind farm into small turbine groups by analyzing the aerodynamic interactions between turbines and utilizing some key principles from the graph theory. It enables the separated conduction of RL algorithms on small turbine groups, avoiding the complex training process and high computational costs of applying RL on the entire farm. Based on automatic grouping, MATL can further reduce the computational complexity by allowing agents (i.e., wind turbines) to inherit control policies under potential group changes. Case studies with a dynamical simulator show that the proposed method achieves clear power generation increases than the benchmark. It also dramatically reduces computational costs compared with typical RL-based wind farm control methods, paving the way for the application of RL in general wind farms.

Deep Reinforcement Learning Based Wind Farm Cluster Reactive Power Optimization Considering Network Switching

Multi-agent Deep Reinforcement Learning Algorithm for Distributed Economic Dispatch in Smart Grid.

DDPG-based Reactive Power Optimization Strategy for Active Distribution Network

A Deep Reinforcement Learning Based Approach for Optimal Active Power Dispatch

Intelligent Wind Farm Control via Grouping-Based Reinforcement Learning

Power balance control of RES integrated power system by deep reinforcement learning with optimized utilization rate of renewable energy

Wind Farm Power Generation Control Via Double-Network-Based Deep Reinforcement Learning

Two-stage ADMM-based Distributed Optimal Reactive Power Control Method for Wind Farms Considering Wake Effects

Double Deep Q-learning Based Real-Time Optimization Strategy for Microgrids

An Improved Deep Reinforcement Learning Method for Dispatch Optimization Strategy of Modern Power Systems

Reactive power optimization via deep transfer reinforcement learning for efficient adaptation to multiple scenarios

Reinforcement Learning-Based Wind Farm Control: Toward Large Farm Applications via Automatic Grouping and Transfer Learning

A Data-driven Method for Fast AC Optimal Power Flow Solutions via Deep Reinforcement Learning

Multi-objective two-stage robust optimization of wind/PV/thermal power system based on meta multi-agent reinforcement learning

Model-Free Optimization Scheme for Efficiency Improvement of Wind Farm Using Decentralized Reinforcement Learning

Research on Electric Hydrogen Hybrid Storage Operation Strategy for Wind Power Fluctuation Suppression

Multi-Objective Interval Optimization Dispatch of Microgrid Via Deep Reinforcement Learning

Adaptive inter-area power oscillation damping from offshore wind farm and MMC-HVDC using deep reinforcement learning

A Holistic Power Optimization Approach for Microgrid Control Based on Deep Reinforcement Learning

Deep Reinforcement Learning-Based Method for Joint Optimization of Mobile Energy Storage Systems and Power Grid with High Renewable Energy Sources

Rolling horizon wind-thermal unit commitment optimization based on deep reinforcement learning