Research on priority scheduling strategy for smoothing power fluctuations of microgrid tie‐lines based on PER‐DDPG algorithm
Lun Dong,Yuan Huang,Xiao Xu,Zhenyuan Zhang,Junyong Liu,Li Pan,Weihao Hu
DOI: https://doi.org/10.1049/gtd2.13267
2024-09-11
IET Generation Transmission & Distribution
Abstract:This study proposes a novel scheduling strategy utilizing a data‐driven approach to smooth power fluctuations, specifically employing a deep reinforcement learning algorithm. The strategy involves scheduling MG's internal power devices using a priority‐level approach while considering the random charging patterns of private electric vehicles. The scheduling optimization models are first formulated as a Markov decision process, with the objective of minimizing tie‐line power fluctuation and MG operation costs. The variability of renewable energy within microgrids (MGs) necessitates the smoothing of power fluctuations through the effective scheduling of internal power equipment. Otherwise, significant power variations on the tie‐line connecting the MG to the main power grid could occur. This study introduces an innovative scheduling strategy that utilizes a data‐driven approach, employing a deep reinforcement learning algorithm to achieve this smoothing effect. The strategy prioritizes the scheduling of MG's internal power devices, taking into account the stochastic charging patterns of electric vehicles. The scheduling optimization model is initially described as a Markov decision process with the goal of minimizing power fluctuations on the interconnection lines and operational costs of the MG. Subsequently, after preprocessing the historical operational data of the MG, an enhanced scheduling strategy is developed through a neural network learning process. Finally, the results from four scheduling scenarios demonstrate the significant impact of the proposed strategy. Comparisons of reward curves before and after data preprocessing underscore its importance. In contrast to optimization results from deep deterministic policy gradient, soft actor‐critic, and particle swarm optimization algorithms, the superiority of the deep deterministic policy gradient algorithm with the addition of a priority experience replay mechanism is highlighted.
engineering, electrical & electronic