Abstract:The decarbonization of energy systems has posed unprecedented challenges in system complexity and operational uncertainty that render it imperative to exploit cutting-edge artificial intelligence (AI) technologies to realize real-time, autonomous power system operation and control. In particular, deep reinforcement learning (DRL)-based approaches in power systems are extensively studied and implemented in several trials worldwide. Nevertheless, the vulnerability of DRL brings new security threats to power systems that have not been well identified and investigated in the literature. To this end, this paper proposes a physics-constrained vulnerability assessment methodological framework for the DRL-based power system operation and control, with a special focus on the problem of security-constrained optimal power flow (SCOPF). In particular, we develop a novel adversarial example generation method, defined as a false data injection attack against the DRL-based SCOPF (FDIAI), to realize a targeted adversarial attack considering the nonlinear physical constraints in power systems via two main stages of constructor function design and unconstrained optimization problem transformation. In this way, the proposed FDIAI can significantly influence the decision-making procedure of DRL while successfully evading the bad data detection mechanism in power systems. Case studies are conducted to explore the stealthiness and effectiveness of FDIAI and then show its severe impacts on system operation and control on the winners' models of the Learning to Run a Power Network (L2RPN) competitions, including L2RPN IJCNN 2019 (IJCNN), L2RPN WCCI 2020 (WCCI), and L2RPN NeurIPS 2020 (NeurIPS).

Predicting Active Constraints Set in Security-Constrained Optimal Power Flow Via Deep Neural Network

Varying Condition SCOPF Based on Deep Learning and Knowledge Graph

Mixed-Integer Linear Programming Model and Constraints Reduction Methods for Security-Constrained Unit Commitment

Transferability-Oriented Adversarial Robust Security-Constrained Optimal Power Flow

DNN-Based Active Constraints Screening to Preprocess SCUC Problem

Fast Economic Dispatch in Smart Grids Using Deep Learning: An Active Constraint Screening Approach

DeepOPF+: A Deep Neural Network Approach for DC Optimal Power Flow for Ensuring Feasibility

Physics-Constrained Vulnerability Assessment of Deep Reinforcement Learning-Based SCOPF

Identification of Inactive Constraints for SCED Model Considering Uncertain Power Injection

Efficient constraint learning for data-driven active distribution network operation

DeepOPF: Deep Neural Network for DC Optimal Power Flow

DeepOPF-U: A Unified Deep Neural Network to Solve AC Optimal Power Flow in Multiple Networks

An ADMM-based Distributed Optimization Method for Solving Security-Constrained AC Optimal Power Flow

OptNet-Embedded Data-Driven Approach for Optimal Power Flow Proxy

Fast Identification of Inactive Security Constraints in SCUC Problems

Spatio-Temporal Deep Learning-Assisted Reduced Security-Constrained Unit Commitment

Security-constrained optimal power flow based on risk ranking of contingencies

Constraints and Variables Reduction for Optimal Power Flow Using Hierarchical Graph Neural Networks with Virtual Node-Splitting

A Sensitivity Based Simplified Model for Security Constrained Optimal Power Flow

Learning to Solve the AC Optimal Power Flow via a Lagrangian Approach

Corrective Security-constrained Optimal Power Flow with Control of Flexible AC Transmission System Devices