Abstract:Once an active distribution network of a cyber-physical system is in alert state, it is vulnerable to cross-domain cascading failures. It is necessary to transit the state of an active distribution network of cyber-physical system from an alert state to a normal state using a preventive control policy against cross-domain cascading failures. In fact, it is difficult to construct and analyze a preventive control policy via theoretical analysis methods or physical experimental methods. The theoretical analysis methods may not be accurate due to approximated models, and the physical experimental methods are expensive and time consuming for building prototypes. This paper presents a preventive control policy construction method based on a deep deterministic policy gradient idea (shorted as PCMD) to generate and optimize a preventive control policy with Artificial Intelligence (AI) technologies. It adopts the reinforcement learning technique to make full use of the available historical data to overcome the problems of high cost and low accuracy. Firstly, a preventive control model is designed based on the finite automaton theory, which can guide the data collection and learning policy selection. The control model considers the voltage stability, frequency stability, current overload prevention, and the control cost reduction as a feedback variable, without the specific power flow equations and differential equations. Then, after enough training, a local optimal preventive control policy can be constructed under the comparability condition among a fitted action-value function and a fitted policy function. The constructed preventive control policy contains some control actions to achieve a low cost and in accord with the principle of shortening a cross-domain cascading failures propagation sequence as far as possible. The PCMD is more flexible and closer to reality than the theoretical analysis methods and has a lower cost than the physical experimental methods. To evaluate the performance of the proposed method, an experimental case study, China Electric Power Research-Cyber-Physical System (shorted as CEPR-CPS), which comes from China Electric Power Research Institute, is carried out. The result shows that the effectiveness of preventive control policy construction with the PCMD is better than most current methods, such as the multi-agent method in terms of reducing the number of failure nodes and avoiding the state space explosion.

Progressive Decision-Making Framework for Power System Topology Control

Efficient Power Grid Topology Control via Two-Stage Action Search

A Graph-based Deep Reinforcement Learning Framework for Autonomous Power Dispatch on Power Systems with Changing Topologies

Hierarchical Reinforcement Learning for Power Network Topology Control

A prior knowledge-embedded reinforcement learning method for real-time active power corrective control in complex power systems

Multi-Agent Reinforcement Learning for Power Grid Topology Optimization

Controlling Directed Networks with Evolving Topologies

Deep Reinforcement Learning Based Approach for Active Power Security Correction Control of Power System

Preventive Control Policy Construction in Active Distribution Network of Cyber-Physical System with Reinforcement Learning

Graph Attention Network Based Deep Reinforcement Learning for Voltage/var Control of Topologically Variable Power System

A Deep Reinforcement Learning Framework for Automatic Operation Control of Power System Considering Extreme Weather Events

Load balancing and topology dynamic adjustment strategy for power information system network: a deep reinforcement learning-based approach

Multi-Stage Transmission Line Flow Control Using Centralized and Decentralized Reinforcement Learning Agents

Real-time Autonomous Line Flow Control Using Proximal Policy Optimization

Online Preventive Control for Transmission Overload Relief Using Safe Reinforcement Learning with Enhanced Spatial-Temporal Awareness

Emergency Voltage Control Strategy for Power System Transient Stability Enhancement Based on Edge Graph Convolutional Network Reinforcement Learning

Active power correction strategies based on deep reinforcement learning-part I: A simulation-driven solution for robustness

Research on Decision-Making for New Power Systems under the Virtual Power Plant Mechanism

On Fast-Converged Deep Reinforcement Learning for Optimal Dispatch of Large-Scale Power Systems under Transient Security Constraints

Real-Time Optimal Power Flow Method Via Safe Deep Reinforcement Learning Based on Primal-Dual and Prior Knowledge Guidance

An Online Topology Control Method for Multi-Agent Systems: Distributed Topology Reconfiguration