Abstract:The integration of renewable energy sources (RES) is rapidly increasing in electric power systems (EPS). While the inclusion of intermittent RES coupled with the wide-scale deployment of communication and sensing devices is important towards a fully smart grid, it has also expanded the cyber-threat landscape, effectively making power systems vulnerable to cyberattacks. This paper proposes a cybersecurity assessment approach designed to assess the cyberphysical security of EPS. The work takes into consideration the intermittent generation of RES, vulnerabilities introduced by microprocessor-based electronic information and operational technology (IT/OT) devices, and contingency analysis results. The proposed approach utilizes deep reinforcement learning (DRL) and an adapted Common Vulnerability Scoring System (CVSS) score tailored to assess vulnerabilities in EPS in order to identify the optimal attack transition policy based on N-2 contingency results, i.e., the simultaneous failure of two system elements. The effectiveness of the work is validated via numerical and real-time simulation experiments performed on literature-based power grid test cases. The results demonstrate how the proposed method based on deep Q-network (DQN) performs closely to a graph-search approach in terms of the number of transitions needed to find the optimal attack policy, without the need for full observation of the system. In addition, the experiments present the method's scalability by showcasing the number of transitions needed to find the optimal attack transition policy in a large system such as the Polish 2383 bus test system. The results exhibit how the proposed approach requires one order of magnitude fewer transitions when compared to a random transition policy.

Risk Assessment of Power System Cascading Outages Based on Deep Reinforcement Learning

An Online Search Method for Representative Risky Fault Chains Based on Reinforcement Learning and Knowledge Transfer

Risk Assessment for Cascading Failures of Complex Power System

Temporal Difference Learning Based Critical Component Identifying Method with Cascading Failure Data in Power Systems

System Resilience Enhancement Against Cascading Failure in Consideration of Uncertainty

Risk Assessment of Power System Cascading Failure Considering Hidden Failures of Protective Relayings

Risk assessment of cascading outages in power systems using fuzzy neural network

Risk assessment of cascading failure in power system based on fuzzy neural network

Risk Assessment of Multi-Timescale Cascading Outages Based on Markovian Tree Search

Key Branches Identification For Cascading Failure Based On Q-Learning Algorithm

Mitigating Multi-Stage Cascading Failure by Reinforcement Learning

Identify Critical Branch Sequences for Cascading Failures Based on Double Q Learning

Resilience Assessment for Power Systems under Sequential Attacks Using Double DQN with Improved Prioritized Experience Replay

Power Grid Cascading Failure Mitigation by Reinforcement Learning

Mitigating Cascading Failure in Power Grids with Deep Reinforcement Learning-Based Remedial Actions

An Optimal Control-Based Cascading Failure Risk Assessment Method

Risk Assessment of Power System Transmission Network Based on Cascading Failure Chains

Adaptive Power System Emergency Control using Deep Reinforcement Learning

Sequential Node/Link Recovery Strategy of Power Grids Based on Q-Learning Approach

Deep Reinforcement Learning for Cybersecurity Assessment of Wind Integrated Power Systems

A Probabilistic Risk Assessment Method for Cascading Failure of Power System