Abstract:As an efficient way to integrate multiple distributed energy resources (DERs) and the user side, a microgrid is mainly faced with the problems of small-scale volatility, uncertainty, intermittency and demand-side uncertainty of DERs. The traditional microgrid has a single form and cannot meet the flexible energy dispatch between the complex demand side and the microgrid. In response to this problem, the overall environment of wind power, thermostatically controlled loads (TCLs), energy storage systems (ESSs), price-responsive loads and the main grid is proposed. Secondly, the centralized control of the microgrid operation is convenient for the control of the reactive power and voltage of the distributed power supply and the adjustment of the grid frequency. However, there is a problem in that the flexible loads aggregate and generate peaks during the electricity price valley. The existing research takes into account the power constraints of the microgrid and fails to ensure a sufficient supply of electric energy for a single flexible load. This paper considers the response priority of each unit component of TCLs and ESSs on the basis of the overall environment operation of the microgrid so as to ensure the power supply of the flexible load of the microgrid and save the power input cost to the greatest extent. Finally, the simulation optimization of the environment can be expressed as a Markov decision process (MDP) process. It combines two stages of offline and online operations in the training process. The addition of multiple threads with the lack of historical data learning leads to low learning efficiency. The asynchronous advantage actor-critic (Memory A3C, M-A3C) with the experience replay pool memory library is added to solve the data correlation and nonstatic distribution problems during training. The multithreaded working feature of M-A3C can efficiently learn the resource priority allocation on the demand side of the microgrid and improve the flexible scheduling of the demand side of the microgrid, which greatly reduces the input cost. Comparison of the researched cost optimization results with the results obtained with the proximal policy optimization (PPO) algorithm reveals that the proposed algorithm has better performance in terms of convergence and optimization economics.

Multi-microgrid Energy Management Based on Finite Horizon Twin Delayed Deep Deterministic Policy Gradient

Distributed Real-Time Energy Management of Multi-microgrid for Incomplete Information Scenarios

A Bayesian Deep Reinforcement Learning-Based Resilient Control for Multi-Energy Micro-Gird

Joint Energy Dispatch and Unit Commitment in Microgrids Based on Deep Reinforcement Learning

Optimal Energy Scheduling for Microgrids with a Hybrid Battery-Hydrogen Storage System Based on Reinforcement Learning

Real-Time Energy Management of a Microgrid Using Deep Reinforcement Learning

Parametric Dueling DQN- and DDPG-Based Approach for Optimal Operation of Microgrids

Research on Energy Management in Hydrogen–Electric Coupled Microgrids Based on Deep Reinforcement Learning

Renewable energy integration and microgrid energy trading using multi-agent deep reinforcement learning

Hybrid Metaheuristic Multi-Layer Reinforcement Learning Approach For Two-Level Energy Management Strategy Framework Of Multi-Microgrid Systems

Energy Scheduling and Decision Learning of Combined Cooling, Heating and Power Microgrid Based on Deep Deterministic Policy Gradient

Dynamic Energy Dispatch Based on Deep Reinforcement Learning in IoT-Driven Smart Isolated Microgrids

Renewable-based microgrids' energy management using smart deep learning techniques: Realistic digital twin case

Distributed Energy Trading and Scheduling Among Microgrids via Multiagent Reinforcement Learning

Deep reinforcement learning for real-time economic energy management of microgrid system considering uncertainties

Hybrid Energy Storage Control Method For DC Microgrid Based On Deep Deterministic Policy Gradient

Intelligent Multi-Microgrid Energy Management Based on Deep Neural Network and Model-Free Reinforcement Learning

Physical-model-free intelligent energy management for a grid-connected hybrid wind-microturbine-PV-EV energy system via deep reinforcement learning approach

Deep Reinforcement Learning Microgrid Optimization Strategy Considering Priority Flexible Demand Side

Multi-energy Management of Interconnected Multi-microgrid System Using Multi-agent Deep Reinforcement Learning

Deep Reinforcement Learning Based Optimal Energy Management of Multi-energy Microgrids with Uncertainties