Abstract:While distributed secondary controllers have been studied for multiple energy storage systems in islanded microgrids, information infrastructure has to be added for the extensive information transmission among these secondary controllers and the additional communication among distributed controllers is costly and increases the vulnerability surface to cyberattacks. In this work, a data-driven decentralized secondary control scheme is proposed for multiple heterogeneous battery energy storage systems (BESSs). The proposed secondary control scheme can achieve frequency regulation and the state-of-charge (SoC) balancing simultaneously for BESSs without requiring accurate BESS models. This scheme leverages an asynchronous advantage actor-critic (A3C) based multi-agent deep reinforcement learning (MA-DRL) algorithm where the centralized off-line learning with shared convolutional neural networks (CNN) is designed to maximize global rewards and ensure the performance of the entire system and a decentralized online execution mechanism is applied to each BESS. Furthermore, in view of possible denial-of-service (DoS) attack on local communication networks used for signal transfer between secondary controllers and remote sensors, a signal-to-interference-plus-noise ratio (SINR)-based dynamic and proactive event-triggered communication mechanism is proposed to alleviate the impact of DoS attacks and reduce the occupation of communication resources. Simulation results on a four-bus multiple BESS system show that the proposed decentralized secondary controller can achieve simultaneous frequency regulation and SoC balancing. Comparison results with other event-triggered mechanisms and MA-DRL algorithms show the A3C based MA-DRL algorithm with CNN can obtain a comparatively optimal policy through training and the designed event-triggered strategy can dynamically adapt the release frequency based on real-time SINR and significantly reduce the occupied network bandwidth and packet loss rate (PER) induced by DoS attacks.

Distributed consensus controlled multi-battery-energy-storage-system under denial-of-service attacks

Event-Triggered Secure Consensus Control for DC Microgrids under DoS Attacks

Robust and Resilient Distributed Optimal Frequency Control for Microgrids Against Cyber Attacks

Resilient Consensus Control Scheme for Distributed Energy Storage Systems in DC Microgrids Against False Data Injection Attacks

Distributed Aperiodic Control of Multibus DC Microgrids with DoS-Attack Resilience

Energy-Management Strategy of Battery Energy Storage Systems in DC Microgrids: A Distributed Fuzzy Output Consensus Control Considering Multiple Cyber Attacks

Distributed Adaptive Consensus Control for Nonlinear Systems with Active-Defense Mechanism Against Denial-of-Service Attacks

Distributed resilient control against denial of service attacks in DC microgrids with constant power load

Resilience-Oriented Control for Cyber-Physical Hybrid Energy Storage Systems Using a Semiconsensus Scheme: Design and Practice

Multi-Agent Reinforcement Learning for Decentralized Resilient Secondary Control of Energy Storage Systems Against DoS Attacks

Steady-State Analysis of Microgrid Distributed Control Under Denial of Service Attacks

Consensus-based Multi-Converter Power Allocation Strategy in Battery Energy Storage System

Real-Time Distributed Control of Battery Energy Storage Systems for Security Constrained DC-OPF

Distributed Event-Based Control for Thermostatically Controlled Loads under Hybrid Cyber Attacks

Distributed Edge-Based Event-Triggered Control for Voltage Restoration and Current Sharing in DC Microgrids Under DoS Attacks

Event-based distributed secondary voltage tracking control of microgrids under DoS attacks

Consensus based SoC trajectory tracking control design for economic-dispatched distributed battery energy storage system

Resilient Discrete-Time Quantization Communication for Distributed Secondary Control of AC Microgrids Under DoS Attacks

Resilient Secondary Control and Stability Analysis for DC Microgrids Under Mixed Cyber Attacks

Event-Triggered Distributed Secondary Control With Model-Free Predictive Compensation in AC/DC Networked Microgrids Under DoS Attacks

Multiagent Distributed Secondary Control for Energy Storage Systems With Lossy Communication Networks in DC Microgrid