Abstract:Emergency control is essential for maintaining the stability of power systems, serving as a key defense mechanism against the destabilization and cascading failures triggered by faults. Under-voltage load shedding is a popular and effective approach for emergency control. However, with the increasing complexity and scale of power systems and the rise in uncertainty factors, traditional approaches struggle with computation speed, accuracy, and scalability issues. Deep reinforcement learning holds significant potential for the power system decision-making problems. However, existing deep reinforcement learning algorithms have limitations in effectively leveraging diverse operational features, which affects the reliability and efficiency of emergency control strategies. This paper presents an innovative approach for real-time emergency voltage control strategies for transient stability enhancement through the integration of edge-graph convolutional networks with reinforcement learning. This method transforms the traditional emergency control optimization problem into a sequential decision-making process. By utilizing the edge-graph convolutional neural network, it efficiently extracts critical information on the correlation between the power system operation status and node branch information, as well as the uncertainty factors involved. Moreover, the clipped double Q-learning, delayed policy update, and target policy smoothing are introduced to effectively solve the issues of overestimation and abnormal sensitivity to hyperparameters in the deep deterministic policy gradient algorithm. The effectiveness of the proposed method in emergency control decision-making is verified by the IEEE 39-bus system and the IEEE 118-bus system.

Double DQN-based Power System Transient Stability Emergency Control with Protection Coordinations

Exploring the Vulnerability of Deep Reinforcement Learning-based Emergency Control for Low Carbon Power Systems

Emergency Control Methods for Power Systems Based on Improved Deep Reinforcement Learning

Transient Stability Emergency Control Strategy of Power System Based on Deep Reinforcement Learning

Deep Reinforcement Learning Based Approach for Active Power Security Correction Control of Power System

Adaptive Power System Emergency Control using Deep Reinforcement Learning

An Efficient Parallel Sequential Approach for Transient Stability Emergency Control of Large-Scale Power System

Emergency Voltage Control Strategy for Power System Transient Stability Enhancement Based on Edge Graph Convolutional Network Reinforcement Learning

Resilience Assessment for Power Systems under Sequential Attacks Using Double DQN with Improved Prioritized Experience Replay

Distributed Hierarchical Deep Reinforcement Learning for Large-Scale Grid Emergency Control

Distributed Deep Reinforcement Learning-based Approach for Fast Preventive Control Considering Transient Stability Constraints

Adaptive Emergency Control of Power Systems Based on Deep Belief Network

Power System Transient Stability Control Method Based on Deep Learning Hybrid Model

An Imitation Learning-based Approach for Power System Transient Stability Emergency Control

A Data-Driven Method for Power System Emergency Control to Improve Short-Term Voltage Stability

Power System Emergency Control to Improve Short-Term Voltage Stability Using Deep Reinforcement Learning Algorithm

Real-time Power System Generator Tripping Control Based on Deep Reinforcement Learning

Deep Reinforcement Learning for Load Shedding Against Short-Term Voltage Instability in Large Power Systems

Power System Operation Mode Calculation Based on Improved Deep Reinforcement Learning

Make Safe Decisions in Power System: Safe Reinforcement Learning Based Pre-decision Making for Voltage Stability Emergency Control

Supervised assisted deep reinforcement learning for emergency voltage control of power systems