Abstract:Microgrids serve an essential role in the smart grid infrastructure, facilitating the seamless integration of distributed energy resources and supporting the increased adoption of renewable energy sources to satisfy the growing demand for sustainable energy solutions. This paper presents an application of integral reinforcement learning (IRL) algorithm-based adaptive optimal control strategy for automatic generation control of an is-landed micro-grid. This algorithm is a model-free actor-critic method that learns the critic parameters using the recursive least square method. The actor is straightforward and evaluates the action from the critic directly. The robustness of the proposed control technique is investigated under various uncertainties arising from parameter uncertainty, electric vehicle (EV) aggregator, and renewable energy sources. This study incorporates case studies and comparative analyses to demonstrate the control performance of the proposed control strategy. The effectiveness of the technique is evaluated by comparing it with deep Q-learning (DQN) control techniques and PI controllers. The proposed controller significantly improves performance metrics compared to the DQN and PI controllers. It reduces the peak frequency deviation by 6 and 14 , respectively, compared to the DQN and PI controllers. When subjected to multiple-step load disturbances, the proposed controller reduces the mean square error by 28 and 42 , respectively, while lowering both the integral absolute error and the integral time absolute error by 21 and 35 compared to the DQN and PI controllers. Additionally, when operating with renewable energy sources, the proposed controller decreases the standard deviation in the frequency deviation by 17 compared to the DQN controller and 23 compared to the PI controller.

Automatic Generation Control Based on Multiple Neural Networks With Actor-Critic Strategy

A Bayesian Deep Reinforcement Learning-Based Resilient Control for Multi-Energy Micro-Gird

Multi-Agent Reinforcement Learning-based Distributed Economic Dispatch Considering Network attacks and Uncertain Costs

Multi-agent Deep Reinforcement Learning Algorithm for Distributed Economic Dispatch in Smart Grid.

Target-Value-Competition-Based Multi-Agent Deep Reinforcement Learning Algorithm for Distributed Nonconvex Economic Dispatch

Automatic Generation Control Strategy with Aggregated Generation Units Based on Mesh Adaptive Multi-Objective Optimization Algorithm

An adaptive active power rolling dispatch strategy for high proportion of renewable energy based on distributed deep reinforcement learning

Large-scale deep reinforcement learning method for energy management of power supply units considering regulation mileage payment

Coordinated Control of Power System Based on Direct Neural Dynamic Programming Method

Coordinated automatic generation control of interconnected power system with imitation guided exploration multi-agent deep reinforcement learning

Automatic Generation Control for Distributed Multi-Region Interconnected Power System with Function Approximation

AC/DC hybrid distribution network reconfiguration with microgrid formation using multi-agent soft actor-critic

Deep Reinforcement Learning Based Coordinated Voltage Control in Smart Distribution Network

Distributed Deep Reinforcement Learning for Renewable Energy Accommodation Assessment With Communication Uncertainty in Internet of Energy

Active power correction strategies based on deep reinforcement learning-part I: A simulation-driven solution for robustness

Emergency fault affected wide-area automatic generation control via large-scale deep reinforcement learning

Automatic generation control of is-landed micro-grid using integral reinforcement learning-based adaptive optimal control strategy

Online Voltage Control Strategy: Multi-Mode Based Data-Driven Approach for Active Distribution Networks

On Training Effective Reinforcement Learning Agents for Real-time Power Grid Operation and Control

Active power correction strategies based on deep reinforcement learning — part II: A distributed solution for adaptability

Wind Farm Power Generation Control Via Double-Network-Based Deep Reinforcement Learning