Abstract:This paper proposes an active coordinated fault tolerance load frequency control (AFCT-LFC) method, which effectively prevents sudden frequency changes caused by unit actuator failures or unplanned decommissioning in a multi-area interconnected grid subject to the performance-based frequency regulation market mechanism. It can also reduce regulation mileage payments and achieve multi-objective active fault-tolerant control. In addition, this paper proposes a brain-Inspired deep meta-deterministic policy gradient algorithm (BIMA-DMDPG), which adopts multi-agent centralized training, equates the controller of each area as an agent capable of independent decision making, and implements distributed training by dividing the environment into multiple environments. In addition, meta-reinforcement learning is employed to realize multi-task collaborative learning. The optimal policy is actively selected under different fault conditions to achieve active fault-tolerant control. The superior performance of the method is verified in a four-area LFC model of the China Southern Grid (CSG), in which it is tested alongside a selection of existing algorithms. Note to Practitioners—AFCT-LFC is based on advanced artificial intelligence algorithm, which can effectively identify any fault in multi-area grids and make rapid response to achieve active fault-tolerant control. Compared with the existing model-based fault-tolerant control methods, the BIMA-DMDPG algorithm proposed in this paper does not need to rely on accurate mathematical models, and can be applied to practice through simple training, which is very suitable for practical applications. Therefore, AFCT-LFC is an advanced adaptive active fault-tolerant control method that can be truly applied in practice because of its fast-decision-making ability and performance.

Coordinated load frequency control of multi-area integrated energy system using multi-agent deep reinforcement learning

Grid-area coordinated load frequency control strategy using large-scale multi-agent deep reinforcement learning

Coordinated automatic generation control of interconnected power system with imitation guided exploration multi-agent deep reinforcement learning

Large-scale deep reinforcement learning method for energy management of power supply units considering regulation mileage payment

Multi-agent Deep Reinforcement Learning Algorithm for Distributed Economic Dispatch in Smart Grid.

Target-Value-Competition-Based Multi-Agent Deep Reinforcement Learning Algorithm for Distributed Nonconvex Economic Dispatch

Distributed deep reinforcement learning for integrated generation‐control and power‐dispatch of interconnected power grid with various renewable units

A Shared Control Approach for Muti-Area Interconnected Power System Via Operational Behaviors Learning

Multiagent deep meta reinforcement learning for sea computing-based energy management of interconnected grids considering renewable energy sources in sustainable cities

Data‐driven cooperative load frequency control method for microgrids using effective exploration‐distributed multi‐agent deep reinforcement learning

Evolutionary Multi Agent Deep Meta Reinforcement Learning Method for Swarm Intelligence Energy Management of Isolated Multi Area Microgrid with Internet of Things

Data-Driven Load Frequency Control Based on Multi-Agent Reinforcement Learning With Attention Mechanism

Brain-Inspired Deep Meta-Reinforcement Learning for Active Coordinated Fault-Tolerant Load Frequency Control of Multi-Area Grids

Distributed quantum multiagent deep meta reinforcement learning for area autonomy energy management of a multiarea microgrid

Efficient experience replay based deep deterministic policy gradient for AGC dispatch in integrated energy system

Distributed energy management of multi-area integrated energy system based on multi-agent deep reinforcement learning

Distributed optimization of electricity-Gas-Heat integrated energy system with multi-agent deep reinforcement learning

Deep reinforcement learning for adaptive frequency control of island microgrid considering control performance and economy

Data-driven load frequency cooperative control for multi-area power system integrated with VSCs and EV aggregators under cyber-attacks

Integrated Energy Cluster Hierarchical Regulation Technology Considering Demand Response

Emergency fault affected wide-area automatic generation control via large-scale deep reinforcement learning