Abstract:The high proportion of renewable energy integration and the dynamic changes in grid topology necessitate the enhancement of voltage/var control (VVC) to manage voltage fluctuations more rapidly. Traditional model-based control algorithms are becoming increasingly incompetent for VVC due to their high model dependence and slow online computation speed. To alleviate these issues, this paper introduces a graph attention network (GAT) based deep reinforcement learning for VVC of topologically variable power systems. Firstly, combining the physical information of the actual power grid, a physics-informed GAT is proposed and embedded into the proximal policy optimization (PPO) algorithm. It can capture topological and spatial correlations among the node features to tackle topology changes. To address the slow training, the improved ReliefF algorithm identifies critical state variables, significantly reducing the dimensionality of state space. Then, the training samples retained in the experience buffer are designed to mitigate the sparse reward issue. Finally, validation on the modified IEEE 39-bus system and an actual power grid demonstrate superior performance compared with state-of-the-art methods, including PPO algorithm and twin delayed deep deterministic policy gradient (TD3) algorithm. The proposed algorithm exhibits enhanced convergence during training, faster solution speed, and improved VVC performance, even in scenarios involving grid topology changes and increased renewable energy integration. Meanwhile, in the adopted cases, the network loss is reduced by 6.9%, 10.8%, and 7.7%, respectively, demonstrating favorable economic outcomes.

Two-stage Voltage Regulation in Power Distribution System Using Graph Convolutional Network-Based Deep Reinforcement Learning in Real Time

Research on the multi-timescale optimal voltage control method for distribution network based on a DQN-DDPG algorithm

MPC-Based Coordinated Voltage Regulation for Distribution Networks with Distributed Generation and Energy Storage System

Two-Stage Multi-Mode Voltage Control for Distribution Networks: A Deep Reinforcement Learning Approach Based on Multiple Intelligences

Two-Timescale Voltage Control in Distribution Grids Using Deep Reinforcement Learning

Deep Reinforcement Learning-Based Voltage Control Method for Distribution Network with High Penetration of Renewable Energy

Deep-Reinforcement-Learning-Based Two-Timescale Voltage Control for Distribution Systems

Dual Timescales Voltages Regulation in Distribution Systems Using Data-driven and Physics-based Optimization

Physics-Informed Graphical Representation-Enabled Deep Reinforcement Learning for Robust Distribution System Voltage Control

Graph Attention Network Based Deep Reinforcement Learning for Voltage/var Control of Topologically Variable Power System

Enhancing the Tolerance of Voltage Regulation to Cyber Contingencies Via Graph-Based Deep Reinforcement Learning

Deep Reinforcement Learning-Based Adaptive Voltage Control of Active Distribution Networks with Multi-terminal Soft Open Point

Deep Reinforcement Learning for Voltage Control and Renewable Accommodation Using Spatial-Temporal Graph Information

A Deep Reinforcement Learning Voltage Control Method for Distribution Network

Online Voltage Control Strategy: Multi-Mode Based Data-Driven Approach for Active Distribution Networks

Coordinated voltage regulation of high renewable-penetrated distribution networks: An evolutionary curriculum-based deep reinforcement learning approach

Deep Reinforcement Learning Enabled Physical-Model-Free Two-Timescale Voltage Control Method for Active Distribution Systems

Model-Free Voltage Regulation of Unbalanced Distribution Network Based on Surrogate Model and Deep Reinforcement Learning

Voltage Control of Distribution Grid with District Cooling Systems Based on Scenario-Classified Reinforcement Learning

Graph Learning-Based Voltage Regulation in Distribution Networks with Multi-Microgrids