Abstract:Once an active distribution network of a cyber-physical system is in alert state, it is vulnerable to cross-domain cascading failures. It is necessary to transit the state of an active distribution network of cyber-physical system from an alert state to a normal state using a preventive control policy against cross-domain cascading failures. In fact, it is difficult to construct and analyze a preventive control policy via theoretical analysis methods or physical experimental methods. The theoretical analysis methods may not be accurate due to approximated models, and the physical experimental methods are expensive and time consuming for building prototypes. This paper presents a preventive control policy construction method based on a deep deterministic policy gradient idea (shorted as PCMD) to generate and optimize a preventive control policy with Artificial Intelligence (AI) technologies. It adopts the reinforcement learning technique to make full use of the available historical data to overcome the problems of high cost and low accuracy. Firstly, a preventive control model is designed based on the finite automaton theory, which can guide the data collection and learning policy selection. The control model considers the voltage stability, frequency stability, current overload prevention, and the control cost reduction as a feedback variable, without the specific power flow equations and differential equations. Then, after enough training, a local optimal preventive control policy can be constructed under the comparability condition among a fitted action-value function and a fitted policy function. The constructed preventive control policy contains some control actions to achieve a low cost and in accord with the principle of shortening a cross-domain cascading failures propagation sequence as far as possible. The PCMD is more flexible and closer to reality than the theoretical analysis methods and has a lower cost than the physical experimental methods. To evaluate the performance of the proposed method, an experimental case study, China Electric Power Research-Cyber-Physical System (shorted as CEPR-CPS), which comes from China Electric Power Research Institute, is carried out. The result shows that the effectiveness of preventive control policy construction with the PCMD is better than most current methods, such as the multi-agent method in terms of reducing the number of failure nodes and avoiding the state space explosion.

Cascading Failure Path Prediction Based on Association Rules in Cyber-Physical Active Distribution Networks.

System Resilience Enhancement Against Cascading Failure in Consideration of Uncertainty

Temporal Difference Learning Based Critical Component Identifying Method with Cascading Failure Data in Power Systems

Cascading Failure Prediction via Causal Inference

Modeling and Analysis of Cascading Failures in Interdependent Cyber-Physical Systems

Preventive Control Policy Construction in Active Distribution Network of Cyber-Physical System with Reinforcement Learning

Cascading failures forecasting based on running state and structure

Predicting Cascading Failures with a Hyperparametric Diffusion Model

SPSRG: a Prediction Approach for Correlated Failures in Distributed Computing Systems

Impact of Cascading Failure on Power Distribution and Data Transmission in Cyber-Physical Power Systems

Modeling and Analysis of Cascading Failures in Cyber-Physical Power Systems under Different Coupling Strategies.

Cascading Failure Analysis of Cyber Physical Power System With Multiple Interdependency and Control Threshold.

Improved Percolation Theory Incorporating Power Flow Analysis to Model Cascading Failures in Cyber-Physical Power System

Cascading Fault Analysis in Cyber–Physical Power Systems Containing Wind Generator Considering Routing Strategy

Modeling Two-Stage Failure Mechanism of Cascading in Cyber-Physical Power Systems

Spatio-Temporal Failure Propagation in Cyber-Physical Power Systems

Prediction of Cascading Failures in Spatial Networks

Data-Driven Identification Model of Vulnerable Set for Cascading Failure in Power Grid

Cascading Failure Risk Assessment Based on Event-Driven Model in a Cyber-physical Power System

Optimization and control of cyber–physical power systems under dual-network interactive cascading failure

Machine Learning Based on Bayes Networks to Predict the Cascading Failure Propagation