Abstract:Emergency control is essential for maintaining the stability of power systems, serving as a key defense mechanism against the destabilization and cascading failures triggered by faults. Under-voltage load shedding is a popular and effective approach for emergency control. However, with the increasing complexity and scale of power systems and the rise in uncertainty factors, traditional approaches struggle with computation speed, accuracy, and scalability issues. Deep reinforcement learning holds significant potential for the power system decision-making problems. However, existing deep reinforcement learning algorithms have limitations in effectively leveraging diverse operational features, which affects the reliability and efficiency of emergency control strategies. This paper presents an innovative approach for real-time emergency voltage control strategies for transient stability enhancement through the integration of edge-graph convolutional networks with reinforcement learning. This method transforms the traditional emergency control optimization problem into a sequential decision-making process. By utilizing the edge-graph convolutional neural network, it efficiently extracts critical information on the correlation between the power system operation status and node branch information, as well as the uncertainty factors involved. Moreover, the clipped double Q-learning, delayed policy update, and target policy smoothing are introduced to effectively solve the issues of overestimation and abnormal sensitivity to hyperparameters in the deep deterministic policy gradient algorithm. The effectiveness of the proposed method in emergency control decision-making is verified by the IEEE 39-bus system and the IEEE 118-bus system.

Power System Emergency Control to Improve Short-Term Voltage Stability Using Deep Reinforcement Learning Algorithm

Exploring the Vulnerability of Deep Reinforcement Learning-based Emergency Control for Low Carbon Power Systems

Deep Reinforcement Leaming for Short-term Voltage Control by Dynamic Load Shedding in China Southem Power Grid

Load Shedding Scheme with Deep Reinforcement Learning to Improve Short-term Voltage Stability

Efficient learning of power grid voltage control strategies via model-based deep reinforcement learning

Efficient Learning of Voltage Control Strategies via Model-based Deep Reinforcement Learning

Adaptive Power System Emergency Control using Deep Reinforcement Learning

Emergency Voltage Control Strategy for Power System Transient Stability Enhancement Based on Edge Graph Convolutional Network Reinforcement Learning

Proximal policy optimization through a deep reinforcement learning framework for remedial action schemes of VSC-HVDC

A Data-Driven Method for Power System Emergency Control to Improve Short-Term Voltage Stability

Deep Reinforcement Learning for Load Shedding Against Short-Term Voltage Instability in Large Power Systems

Transient Stability Emergency Control Strategy of Power System Based on Deep Reinforcement Learning

Make Safe Decisions in Power System: Safe Reinforcement Learning Based Pre-decision Making for Voltage Stability Emergency Control

Deep Reinforcement Learning Based Approach for Active Power Security Correction Control of Power System

Deep Reinforcement Learning for Voltage Control and Renewable Accommodation Using Spatial-Temporal Graph Information

Distributed Deep Reinforcement Learning-based Approach for Fast Preventive Control Considering Transient Stability Constraints

Deep Reinforcement Learning for Long-Term Voltage Stability Control

Stability Constrained Reinforcement Learning for Decentralized Real-Time Voltage Control

Supervised assisted deep reinforcement learning for emergency voltage control of power systems

Deep Reinforcement Learning Based Voltage Control Revisited