Abstract:The decarbonization of energy systems has posed unprecedented challenges in system complexity and operational uncertainty that render it imperative to exploit cutting-edge artificial intelligence (AI) technologies to realize real-time, autonomous power system operation and control. In particular, deep reinforcement learning (DRL)-based approaches in power systems are extensively studied and implemented in several trials worldwide. Nevertheless, the vulnerability of DRL brings new security threats to power systems that have not been well identified and investigated in the literature. To this end, this paper proposes a physics-constrained vulnerability assessment methodological framework for the DRL-based power system operation and control, with a special focus on the problem of security-constrained optimal power flow (SCOPF). In particular, we develop a novel adversarial example generation method, defined as a false data injection attack against the DRL-based SCOPF (FDIAI), to realize a targeted adversarial attack considering the nonlinear physical constraints in power systems via two main stages of constructor function design and unconstrained optimization problem transformation. In this way, the proposed FDIAI can significantly influence the decision-making procedure of DRL while successfully evading the bad data detection mechanism in power systems. Case studies are conducted to explore the stealthiness and effectiveness of FDIAI and then show its severe impacts on system operation and control on the winners' models of the Learning to Run a Power Network (L2RPN) competitions, including L2RPN IJCNN 2019 (IJCNN), L2RPN WCCI 2020 (WCCI), and L2RPN NeurIPS 2020 (NeurIPS).

Resilient Collaborative Distributed AC Optimal Power Flow Against False Data Injection Attacks: A Theoretical Framework

Transferability-Oriented Adversarial Robust Security-Constrained Optimal Power Flow

Multi-Objective False Data Injection Attacks of Cyber–Physical Power Systems

Defense Optimization in Power Systems against False Data Injection Attacks

Resilient Distributed DC Optimal Power Flow Against Data Integrity Attack.

False Data Injection Attacks in Power Distribution Systems Considering the Characteristics of Distributed Photovoltaic

Attack Detection and Mitigation for Resilient Distributed Dc Optimal Power Flow in the Iot Environment

An Attack-Resilient Distributed Dc Optimal Power Flow Algorithm Via Neighborhood Monitoring

Resilient Consensus Control Scheme for Distributed Energy Storage Systems in DC Microgrids Against False Data Injection Attacks

Distributed Attack Detection of Multi-area Power Systems Against False Data Injection Attacks

AC False Data Injection Attacks in Power Systems: Design and Optimization

A Privacy-preserving Algorithm for AC Microgrid Cyber-physical System Against False Data Injection Attacks

False Data Injection- and Propagation-Aware Game Theoretical Approach for Microgrids

Physics-Constrained Vulnerability Assessment of Deep Reinforcement Learning-Based SCOPF

Cybersecurity Analysis of Data-Driven Power System Stability Assessment

Detection of False Data Injection Attacks on Smart Grids: A Resilience-Enhanced Scheme

Distributed host-based collaborative detection for false data injection attacks in smart grid cyber-physical system

A FDI Attack-Resilient Distributed Secondary Control Strategy for Islanded Microgrids

Game Theory Based Optimal Defensive Resources Allocation with Incomplete Information in Cyber-Physical Power Systems Against False Data Injection Attacks

Resilient Defense of False Data Injection Attacks in Smart Grids via Virtual Hidden Networks

Economic Impact of Data Integrity Attacks on Distributed Dc Optimal Power Flow Algorithm