Abstract:This paper proposes an active coordinated fault tolerance load frequency control (AFCT-LFC) method, which effectively prevents sudden frequency changes caused by unit actuator failures or unplanned decommissioning in a multi-area interconnected grid subject to the performance-based frequency regulation market mechanism. It can also reduce regulation mileage payments and achieve multi-objective active fault-tolerant control. In addition, this paper proposes a brain-Inspired deep meta-deterministic policy gradient algorithm (BIMA-DMDPG), which adopts multi-agent centralized training, equates the controller of each area as an agent capable of independent decision making, and implements distributed training by dividing the environment into multiple environments. In addition, meta-reinforcement learning is employed to realize multi-task collaborative learning. The optimal policy is actively selected under different fault conditions to achieve active fault-tolerant control. The superior performance of the method is verified in a four-area LFC model of the China Southern Grid (CSG), in which it is tested alongside a selection of existing algorithms. Note to Practitioners—AFCT-LFC is based on advanced artificial intelligence algorithm, which can effectively identify any fault in multi-area grids and make rapid response to achieve active fault-tolerant control. Compared with the existing model-based fault-tolerant control methods, the BIMA-DMDPG algorithm proposed in this paper does not need to rely on accurate mathematical models, and can be applied to practice through simple training, which is very suitable for practical applications. Therefore, AFCT-LFC is an advanced adaptive active fault-tolerant control method that can be truly applied in practice because of its fast-decision-making ability and performance.

Multiagent deep meta reinforcement learning for sea computing-based energy management of interconnected grids considering renewable energy sources in sustainable cities

Multi-agent Deep Reinforcement Learning Algorithm for Distributed Economic Dispatch in Smart Grid.

Evolutionary Multi Agent Deep Meta Reinforcement Learning Method for Swarm Intelligence Energy Management of Isolated Multi Area Microgrid with Internet of Things

Distributed quantum multiagent deep meta reinforcement learning for area autonomy energy management of a multiarea microgrid

Grid-area coordinated load frequency control strategy using large-scale multi-agent deep reinforcement learning

Large-scale deep reinforcement learning method for energy management of power supply units considering regulation mileage payment

Coordinated load frequency control of multi-area integrated energy system using multi-agent deep reinforcement learning

Data-Driven Load Frequency Control Based on Multi-Agent Reinforcement Learning With Attention Mechanism

Brain-Inspired Deep Meta-Reinforcement Learning for Active Coordinated Fault-Tolerant Load Frequency Control of Multi-Area Grids

Multi-Microgrid Collaborative Optimization Scheduling Using an Improved Multi-Agent Soft Actor-Critic Algorithm

Data‐driven cooperative load frequency control method for microgrids using effective exploration‐distributed multi‐agent deep reinforcement learning

Distributed energy management of multi-area integrated energy system based on multi-agent deep reinforcement learning

Deep reinforcement learning for adaptive frequency control of island microgrid considering control performance and economy

A Multiagent Reinforcement Learning Approach for Wind Farm Frequency Control

Multi-agent Deep Reinforcement Learning for Distributed Energy Management and Strategy Optimization of Microgrid Market

Distributed Energy Trading and Scheduling Among Microgrids via Multiagent Reinforcement Learning

Collaborative Optimization of Multi-microgrids System with Shared Energy Storage Based on Multi-agent Stochastic Game and Reinforcement Learning

Renewable energy integration and microgrid energy trading using multi-agent deep reinforcement learning

Deep Reinforcement Learning-driven Cross-Community Energy Interaction Optimal Scheduling

Multi-agent deep reinforcement learning based distributed control architecture for interconnected multi-energy microgrid energy management and optimization

Multi-Agent Reinforcement Learning for Smart Community Energy Management