Abstract:While distributed secondary controllers have been studied for multiple energy storage systems in islanded microgrids, information infrastructure has to be added for the extensive information transmission among these secondary controllers and the additional communication among distributed controllers is costly and increases the vulnerability surface to cyberattacks. In this work, a data-driven decentralized secondary control scheme is proposed for multiple heterogeneous battery energy storage systems (BESSs). The proposed secondary control scheme can achieve frequency regulation and the state-of-charge (SoC) balancing simultaneously for BESSs without requiring accurate BESS models. This scheme leverages an asynchronous advantage actor-critic (A3C) based multi-agent deep reinforcement learning (MA-DRL) algorithm where the centralized off-line learning with shared convolutional neural networks (CNN) is designed to maximize global rewards and ensure the performance of the entire system and a decentralized online execution mechanism is applied to each BESS. Furthermore, in view of possible denial-of-service (DoS) attack on local communication networks used for signal transfer between secondary controllers and remote sensors, a signal-to-interference-plus-noise ratio (SINR)-based dynamic and proactive event-triggered communication mechanism is proposed to alleviate the impact of DoS attacks and reduce the occupation of communication resources. Simulation results on a four-bus multiple BESS system show that the proposed decentralized secondary controller can achieve simultaneous frequency regulation and SoC balancing. Comparison results with other event-triggered mechanisms and MA-DRL algorithms show the A3C based MA-DRL algorithm with CNN can obtain a comparatively optimal policy through training and the designed event-triggered strategy can dynamically adapt the release frequency based on real-time SINR and significantly reduce the occupied network bandwidth and packet loss rate (PER) induced by DoS attacks.

Distributed Round-Robin Protocol-Based Secondary Control for ESSs under FDI Attacks

A FDI Attack-Resilient Distributed Secondary Control Strategy for Islanded Microgrids

Resilient Consensus Control Scheme for Distributed Energy Storage Systems in DC Microgrids Against False Data Injection Attacks

False Data Injection Attacks Against State Estimation in Multiphase and Unbalanced Smart Distribution Systems

Distributed Event-Triggered Learning-Based Control for Battery Energy Storage Systems Under Persistent False Data Injection Attacks

Distributed Secondary Control Strategy Against Bounded FDI Attacks for Microgrid With Layered Communication Network

False Data Injection on State Estimation in Power Systems—Attacks, Impacts, and Defense: A Survey

Distributed Resilient Secondary Control for Islanded DC Microgrids Considering Unbounded FDI Attacks

Defending Against False Data Injection Attacks on Power System State Estimation

Secure State Estimation of DC Microgrid System under False Data Injection Attack

Differential Evolution-Based Three Stage Dynamic Cyber-Attack of Cyber-Physical Power Systems

Distributed consensus controlled multi-battery-energy-storage-system under denial-of-service attacks

Co-Estimation of State and FDI Attacks and Attack Compensation Control for Multi-Area Load Frequency Control Systems Under FDI and DoS Attacks

On Feasibility and Limitations of Detecting False Data Injection Attacks on Power Grid State Estimation Using D-FACTS Devices

False Data Injection Attacks Against State Estimation in Power Distribution Systems.

Distributed Adaptive Consensus Control for Nonlinear Systems with Active-Defense Mechanism Against Denial-of-Service Attacks

Attack Resilient Strategy for Event-Triggered Distributed Control Scheme of Multi-energy Systems

Multi-Agent Reinforcement Learning for Decentralized Resilient Secondary Control of Energy Storage Systems Against DoS Attacks

A High-Order Differentiator Based Distributed Secondary Control for DC Microgrids Against False Data Injection Attacks

Protocol-Based Distributed Security Fusion Estimation for Time-Varying Uncertain Systems Over Sensor Networks: Tackling DoS Attacks

Distributed Consensus Fuzzy Control Method and Fractional Order Control for Power Sharing in Field Medical Microgrids under FDI Attacks