Abstract:Decarbonization of global power systems significantly increases the operational uncertainty and modeling complexity that drive the necessity of widely exploiting cutting-edge Deep Reinforcement Learning (DRL) technologies to realize adaptive and real-time emergency control, which is the last resort for system stability and resiliency. The vulnerability of the DRL-based emergency control scheme may lead to severe real-world security issues if it can not be fully explored before implementing it practically. To this end, this is the first work that comprehensively investigates adversarial attacks and defense mechanisms for DRL-based power system emergency control. In particular, recovery-targeted (RT) adversarial attacks are designed for gradient-based approaches, aiming to dramatically degrade the effectiveness of the conducted emergency control actions to prevent the system from restoring to a stable state. Furthermore, the corresponding robust defense (RD) mechanisms are proposed to actively modify the observations based on the distances of sequential states. Experiments are conducted based on the standard IEEE reliability test system, and the results show that security risks indeed exist in the state-of-the-art DRL-based power system emergency control models. The effectiveness, stealthiness, instantaneity, and transferability of the proposed attacks and defense mechanisms are demonstrated with both white-box and black-box settings.

A Deep Reinforcement Learning Framework for Automatic Operation Control of Power System Considering Extreme Weather Events

Exploring the Vulnerability of Deep Reinforcement Learning-based Emergency Control for Low Carbon Power Systems

A deep reinforcement learning-based resilience enhancement framework for distribution networks under extreme weather events

Deep Reinforcement Learning Framework for Resilience Enhancement of Distribution Systems under Extreme Weather Events

Adaptive Power System Emergency Control using Deep Reinforcement Learning

Deep Reinforcement Learning Based Approach for Active Power Security Correction Control of Power System

A Deep Reinforcement Learning Based Approach for Optimal Active Power Dispatch

Stochastic Planning for Resilient Infrastructure of Distribution System under Extreme Weather Events

A Graph-based Deep Reinforcement Learning Framework for Autonomous Power Dispatch on Power Systems with Changing Topologies

Deep Reinforcement Learning for Distribution System Restoration Using Distributed Energy Resources and Tie-Switches

A Data-driven Method for Fast AC Optimal Power Flow Solutions via Deep Reinforcement Learning

On Training Effective Reinforcement Learning Agents for Real-time Power Grid Operation and Control

A Deep Reinforcement Learning Based Framework for Power System Load Frequency Control

Deep Forest Reinforcement Learning for Preventive Strategy Considering Automatic Generation Control in Large-Scale Interconnected Power Systems

Learning and Fast Adaptation for Grid Emergency Control via Deep Meta Reinforcement Learning

A Safe DRL Method for Fast Solution of Real-Time Optimal Power Flow

Deep Reinforcement Learning for Power System Applications: An Overview

Autonomous Voltage Control for Grid Operation Using Deep Reinforcement Learning

Power System Emergency Control to Improve Short-Term Voltage Stability Using Deep Reinforcement Learning Algorithm

Hierarchical deep reinforcement learning for self-adaptive economic dispatch

Review of Deep Reinforcement Learning and Its Application in Modern Renewable Power System Control