Abstract:The integration of renewable energy sources (RES) is rapidly increasing in electric power systems (EPS). While the inclusion of intermittent RES coupled with the wide-scale deployment of communication and sensing devices is important towards a fully smart grid, it has also expanded the cyber-threat landscape, effectively making power systems vulnerable to cyberattacks. This paper proposes a cybersecurity assessment approach designed to assess the cyberphysical security of EPS. The work takes into consideration the intermittent generation of RES, vulnerabilities introduced by microprocessor-based electronic information and operational technology (IT/OT) devices, and contingency analysis results. The proposed approach utilizes deep reinforcement learning (DRL) and an adapted Common Vulnerability Scoring System (CVSS) score tailored to assess vulnerabilities in EPS in order to identify the optimal attack transition policy based on N-2 contingency results, i.e., the simultaneous failure of two system elements. The effectiveness of the work is validated via numerical and real-time simulation experiments performed on literature-based power grid test cases. The results demonstrate how the proposed method based on deep Q-network (DQN) performs closely to a graph-search approach in terms of the number of transitions needed to find the optimal attack policy, without the need for full observation of the system. In addition, the experiments present the method's scalability by showcasing the number of transitions needed to find the optimal attack transition policy in a large system such as the Polish 2383 bus test system. The results exhibit how the proposed approach requires one order of magnitude fewer transitions when compared to a random transition policy.

Physics-Constrained Vulnerability Assessment of Deep Reinforcement Learning-Based SCOPF

Exploring the Vulnerability of Deep Reinforcement Learning-based Emergency Control for Low Carbon Power Systems

Transferability-Oriented Adversarial Robust Security-Constrained Optimal Power Flow

Highly transferable adversarial attack against deep‐reinforcement‐learning‐based frequency control

Deep Reinforcement Learning for Cybersecurity Assessment of Wind Integrated Power Systems

A Safe DRL Method for Fast Solution of Real-Time Optimal Power Flow

On Fast-Converged Deep Reinforcement Learning for Optimal Dispatch of Large-Scale Power Systems under Transient Security Constraints

Cybersecurity Analysis of Data-Driven Power System Stability Assessment

Towards Risk-Aware Real-Time Security Constrained Economic Dispatch: A Tailored Deep Reinforcement Learning Approach

Adaptive Power System Emergency Control using Deep Reinforcement Learning

Load Frequency Control with Deep Reinforcement Learning under Adversarial Attacks

A Novel Bifurcation Method for Observation Perturbation Attacks on Reinforcement Learning Agents: Load Altering Attacks on a Cyber Physical Power System

Robust preventive and corrective security-constrained OPF for worst contingencies with the adoption of VPP: A safe reinforcement learning approach

Improving Robustness of Reinforcement Learning for Power System Control with Adversarial Training

Constrained Reinforcement Learning for Predictive Control in Real-Time Stochastic Dynamic Optimal Power Flow

Load Redistribution Attack in Optimal Power Flow with Phase Shifting Transformers

Multi-Objective False Data Injection Attacks of Cyber–Physical Power Systems

Physics-Constrained Robustness Verification of Intelligent Security Assessment for Power Systems

A Data-driven Method for Fast AC Optimal Power Flow Solutions via Deep Reinforcement Learning

Physics-Constrained Backdoor Attacks on Power System Fault Localization

Safe deep reinforcement learning for real-time AC optimal power flow: A near-optimal solution