Abstract:The decarbonization of energy systems has posed unprecedented challenges in system complexity and operational uncertainty that render it imperative to exploit cutting-edge artificial intelligence (AI) technologies to realize real-time, autonomous power system operation and control. In particular, deep reinforcement learning (DRL)-based approaches in power systems are extensively studied and implemented in several trials worldwide. Nevertheless, the vulnerability of DRL brings new security threats to power systems that have not been well identified and investigated in the literature. To this end, this paper proposes a physics-constrained vulnerability assessment methodological framework for the DRL-based power system operation and control, with a special focus on the problem of security-constrained optimal power flow (SCOPF). In particular, we develop a novel adversarial example generation method, defined as a false data injection attack against the DRL-based SCOPF (FDIAI), to realize a targeted adversarial attack considering the nonlinear physical constraints in power systems via two main stages of constructor function design and unconstrained optimization problem transformation. In this way, the proposed FDIAI can significantly influence the decision-making procedure of DRL while successfully evading the bad data detection mechanism in power systems. Case studies are conducted to explore the stealthiness and effectiveness of FDIAI and then show its severe impacts on system operation and control on the winners' models of the Learning to Run a Power Network (L2RPN) competitions, including L2RPN IJCNN 2019 (IJCNN), L2RPN WCCI 2020 (WCCI), and L2RPN NeurIPS 2020 (NeurIPS).

A Data-driven Approach for Reverse Engineering Electric Power Protocols.

Automatic Protocol Reverse Engineering for Industrial Control Systems with Dynamic Taint Analysis

ABInfer: A Novel Field Boundaries Inference Approach for Protocol Reverse Engineering

Towards Automatically Reverse Engineering Vehicle Diagnostic Protocols

Reverse Engineering Industrial Protocols Driven by Control Fields

PREIUD: An Industrial Control Protocols Reverse Engineering Tool Based on Unsupervised Learning and Deep Neural Network Methods

Network Communication Protocol Reverse Engineering Based on Auto-Encoder

Transferability-Oriented Adversarial Robust Security-Constrained Optimal Power Flow

On Manually Reverse Engineering Communication Protocols of Linux Based IoT Systems

On Manually Reverse Engineering Communication Protocols of Linux-Based IoT Systems

Physics-Constrained Vulnerability Assessment of Deep Reinforcement Learning-Based SCOPF

Practice and Reflection on Data-Driven Modeling in Electric Power Domain

A Semantics Aware Approach to Automated Reverse Engineering Unknown Protocols

NetPlier: Probabilistic Network Protocol Reverse Engineering from Message Traces.

Sub-messages extraction for industrial control protocol reverse engineering

DynPRE: Protocol Reverse Engineering Via Dynamic Inference

Power Evaluation Methods for Data Encryption Algorithms

Protocol Reverse Engineering Using LDA and Association Analysis.

MDIplier: Protocol Format Recovery Via Hierarchical Inference

Research on Deep Detection Technology of Abnormal Behavior of Power Industrial Control System

A Data-Driven Based Security Situational Awareness Framework for Power Systems