Abstract:Wind energy has been increasingly adopted to mitigate climate change. However, the variability of wind energy causes wind curtailment, resulting in considerable economic losses for wind farm owners. Wind curtailment can be reduced using battery energy storage systems (BESS) as onsite backup sources. Yet, this auxiliary role may significantly weaken the economic potential of BESS in energy trading. Ideal BESS scheduling should balance onsite wind curtailment reduction and market bidding, but practical implementation is challenging due to coordination complexity and the stochastic nature of energy prices and wind generation. We investigate the joint-market bidding strategy of a co-located wind-battery system in the spot and Regulation Frequency Control Ancillary Service markets. We propose a novel deep reinforcement learning-based approach that decouples the system's market participation into two related Markov decision processes for each facility, enabling the BESS to absorb onsite wind curtailment while performing joint-market bidding to maximize overall operational revenues. Using realistic wind farm data, we validated the coordinated bidding strategy, with outcomes surpassing the optimization-based benchmark in terms of higher revenue by approximately 25\% and more wind curtailment reduction by 2.3 times. Our results show that joint-market bidding can significantly improve the financial performance of wind-battery systems compared to participating in each market separately. Simulations also show that using curtailed wind generation as a power source for charging the BESS can lead to additional financial gains. The successful implementation of our algorithm would encourage co-location of generation and storage assets to unlock wider system benefits.

Real-time Economic Dispatch of Thermal-Wind-Battery Hybrid Systems Based on Deep Reinforcement Learning

Multi-agent Deep Reinforcement Learning Algorithm for Distributed Economic Dispatch in Smart Grid.

Optimal dispatch of integrated energy system based on deep reinforcement learning

An advanced real-time dispatching strategy for a distributed energy system based on the reinforcement learning algorithm

An Improved Deep Reinforcement Learning Method for Dispatch Optimization Strategy of Modern Power Systems

Joint Optimization Dispatching for Hybrid Power System Based on Deep Reinforcement Learning

Multi-Objective Optimal Dispatch Of Power Systems Integrated With Intermittent Renewable Energy Considering Demand Response

Deep-Reinforcement-Learning-Based Low-Carbon Economic Dispatch for Community-Integrated Energy System under Multiple Uncertainties

Optimal dispatch of an integrated energy system based on deep reinforcement learning considering new energy uncertainty

Hierarchical deep reinforcement learning for self-adaptive economic dispatch

Self-Dispatch of Wind-Storage Integrated System: A Deep Reinforcement Learning Approach

Intelligent Scheduling of Wind-Solar-Hydro-Battery Complementary System Based on Deep Reinforcement Learning

Load Forecasting-Based Learning System for Energy Management With Battery Degradation Estimation: A Deep Reinforcement Learning Approach

Rolling Horizon Robust Real-Time Economic Dispatch with Multi-Stage Dynamic Modeling

Mitigating the Impact of Photovoltaic Power Ramps on Intraday Economic Dispatch Using Reinforcement Forecasting

Low-carbon Economic Dispatch of Electricity-Heat-Gas Integrated Energy Systems Based on Deep Reinforcement Learning

Real-time dispatch of an integrated energy system based on multi-stage reinforcement learning with an improved action-choosing strategy

A Deep Reinforcement Learning Based Approach for Optimal Active Power Dispatch

Dueling Double Q-learning Based Real-time Energy Dispatch in Grid-connected Microgrids

Deep Reinforcement Learning-Based Method for Joint Optimization of Mobile Energy Storage Systems and Power Grid with High Renewable Energy Sources

Deep Reinforcement Learning for Wind and Energy Storage Coordination in Wholesale Energy and Ancillary Service Markets