Abstract:Demand response improves grid security by adjusting the flexibility of consumers meanwhile maintaining their demand–supply balance in real-time. With the large-scale deployment of distributed digital communication technologies and advanced metering infrastructures, data-driven approaches such as multi-agent reinforcement learning (MARL) are being widely employed to solve demand response problems. Nevertheless, the massive interaction of data inside and outside the demand response management system may lead to severe threats from the perspective of cyber-attacks. The cyber security requirements of MARL-based demand response problems are less discussed in the existing studies. To this end, this paper proposes a robust adversarial multi-agent reinforcement learning framework for demand response (RAMARL-DR) with an enhanced resilience against adversarial attacks. In particular, the proposed RAMARL-DR first constructs an adversary agent that aims to cause the worst-case performance via formulating an adversarial attack; and then adopts periodic alternating robust adversarial training scenarios with the optimal adversary aiming to diminish the severe impacts induced by adversarial attacks. Case studies are conducted based on an OpenAI Gym environment CityLearn, which provides a standard evaluation platform of MARL algorithms for demand response problems. Empirical results indicate that the MARL-based demand response management system is vulnerable when the adversary agent occurs, and its performance can be significantly improved after periodic alternating robust adversarial training. It can be found that the adversary agent can result in a 41.43% higher metric value of Ramping than the no adversary case, whereas the proposed RAMARL-DR can significantly enhance the system resilience with an approximately 38.85% reduction in the ramping of net demand.

A Security Mechanism for Demand Response Using RBAC and Pub/sub.

A Periodic Allocation Mechanism for Allocating Demand Response Reserves Deployed by Multiple Ancillary Services

A Novel Microgrid Based Resilient Demand Response Scheme in Smart Grid.

Event-oriented Dynamic Security Service for Demand Response in Smart Grid Employing Mobile Networks

A Game Theory-Based Interactive Demand Response for Handling Dynamic Prices in Security-Constrained Electricity Markets

Demand Response Management with Multiple Utility Companies: A Two-Level Game Approach.

Resilience Enhancement of Multi-Agent Reinforcement Learning-Based Demand Response Against Adversarial Attacks

Demand Response Control of Smart Buildings Integrated With Security Interconnection

Benefits and Cyber-Vulnerability of Demand Response System in Real-Time Grid Operations

Security Communication Mechanism Research On Energy Information Gateway In Smart Grid

Secure and Robust Demand Response Using Stackelberg Game Model and Energy Blockchain

Demand Response Transaction Framework Based on Blockchain and Secure Multi-party Computation

An Overview of Demand Response: From its Origins to the Smart Energy Community

Edge-End Based Demand Response System of Aggregated Residential Load: Case Study

DRBAC based access control method in substation automation system

Secure Distributed Control for Demand Response in Power Systems Against Deception Cyber-Attacks With Arbitrary Patterns

Optimal Residential Demand Response in Distribution Networks

Privacy-preserving Demand Response of Aggregated Residential Load

Assessing the Privacy Cost in Centralized Event-Based Demand Response for Microgrids

Demand response model and impact studies based on bidirectional interactive of information and electrical energy