Abstract:Emergency control is essential for maintaining the stability of power systems, serving as a key defense mechanism against the destabilization and cascading failures triggered by faults. Under-voltage load shedding is a popular and effective approach for emergency control. However, with the increasing complexity and scale of power systems and the rise in uncertainty factors, traditional approaches struggle with computation speed, accuracy, and scalability issues. Deep reinforcement learning holds significant potential for the power system decision-making problems. However, existing deep reinforcement learning algorithms have limitations in effectively leveraging diverse operational features, which affects the reliability and efficiency of emergency control strategies. This paper presents an innovative approach for real-time emergency voltage control strategies for transient stability enhancement through the integration of edge-graph convolutional networks with reinforcement learning. This method transforms the traditional emergency control optimization problem into a sequential decision-making process. By utilizing the edge-graph convolutional neural network, it efficiently extracts critical information on the correlation between the power system operation status and node branch information, as well as the uncertainty factors involved. Moreover, the clipped double Q-learning, delayed policy update, and target policy smoothing are introduced to effectively solve the issues of overestimation and abnormal sensitivity to hyperparameters in the deep deterministic policy gradient algorithm. The effectiveness of the proposed method in emergency control decision-making is verified by the IEEE 39-bus system and the IEEE 118-bus system.

Graph Attention Network Based Deep Reinforcement Learning for Voltage/var Control of Topologically Variable Power System

Research on Volt/Var Control of Distribution Networks Based on PPO Algorithm

Simplified Deep Reinforcement Learning Based Volt-var Control of Topologically Variable Power System

A Graph Policy Network Approach for Volt-Var Control in Power Distribution Systems

Spatio-Temporal Graph Convolutional Neural Networks for Physics-Aware Grid Learning Algorithms

Deep Reinforcement Learning for Voltage Control and Renewable Accommodation Using Spatial-Temporal Graph Information

Two-stage Voltage Regulation in Power Distribution System Using Graph Convolutional Network-Based Deep Reinforcement Learning in Real Time

Physical-assisted multi-agent graph reinforcement learning enabled fast voltage regulation for PV-rich active distribution network

Multi Agent Safe Graph Reinforcement Learning for PV Inverter s Based Real-Time De centralized Volt/Var Control in Zoned Distribution Networks

Autonomous Voltage Control for Grid Operation Using Deep Reinforcement Learning

Multi-Agent Graph-Attention Deep Reinforcement Learning for Post-Contingency Grid Emergency Voltage Control

Power Grid Reactive Voltage Control Method Based on Improved Reinforcement Learning

Emergency Voltage Control Strategy for Power System Transient Stability Enhancement Based on Edge Graph Convolutional Network Reinforcement Learning

Consensus Multi-Agent Reinforcement Learning for Volt-VAR Control in Power Distribution Networks

Graph Neural Networks for Voltage Stability Margins with Topology Flexibilities

Multi-agent Graph Reinforcement Learning for Decentralized Volt-VAR Control in Power Distribution Systems

Deep-Reinforcement-Learning-Based Two-Timescale Voltage Control for Distribution Systems

Physics-Informed Graphical Representation-Enabled Deep Reinforcement Learning for Robust Distribution System Voltage Control

Graph Multi-Agent Reinforcement Learning for Inverter-Based Active Voltage Control

Deep Reinforcement Learning Enabled Physical-Model-Free Two-Timescale Voltage Control Method for Active Distribution Systems