Abstract:As an efficient way to integrate multiple distributed energy resources (DERs) and the user side, a microgrid is mainly faced with the problems of small-scale volatility, uncertainty, intermittency and demand-side uncertainty of DERs. The traditional microgrid has a single form and cannot meet the flexible energy dispatch between the complex demand side and the microgrid. In response to this problem, the overall environment of wind power, thermostatically controlled loads (TCLs), energy storage systems (ESSs), price-responsive loads and the main grid is proposed. Secondly, the centralized control of the microgrid operation is convenient for the control of the reactive power and voltage of the distributed power supply and the adjustment of the grid frequency. However, there is a problem in that the flexible loads aggregate and generate peaks during the electricity price valley. The existing research takes into account the power constraints of the microgrid and fails to ensure a sufficient supply of electric energy for a single flexible load. This paper considers the response priority of each unit component of TCLs and ESSs on the basis of the overall environment operation of the microgrid so as to ensure the power supply of the flexible load of the microgrid and save the power input cost to the greatest extent. Finally, the simulation optimization of the environment can be expressed as a Markov decision process (MDP) process. It combines two stages of offline and online operations in the training process. The addition of multiple threads with the lack of historical data learning leads to low learning efficiency. The asynchronous advantage actor-critic (Memory A3C, M-A3C) with the experience replay pool memory library is added to solve the data correlation and nonstatic distribution problems during training. The multithreaded working feature of M-A3C can efficiently learn the resource priority allocation on the demand side of the microgrid and improve the flexible scheduling of the demand side of the microgrid, which greatly reduces the input cost. Comparison of the researched cost optimization results with the results obtained with the proximal policy optimization (PPO) algorithm reveals that the proposed algorithm has better performance in terms of convergence and optimization economics.

Neighborhood-level coordination and negotiation techniques for managing demand-side flexibility in residential microgrids

A Multi-Timescale Allocation Algorithm of Energy and Power for Demand Response in Smart Grids: A Stackelberg Game Approach

Research on Real-Time Coordinated Optimization Scheduling Control Strategy with Supply-Side Flexibility in Multi-Microgrid Energy Systems

Energy Management of Microgrid in Grid-Connected and Stand-Alone Modes

Distributed Energy Management for Supply-Demand Coordination in a Smart Grid

Distributed stochastic energy coordination for residential prosumers: Framework and implementation

Research on distribution–microgrid-coupled network demand response based on a multi-time scale

Control and Communication Protocols that Enable Smart Building Microgrids

A hierarchical structure for harnessing the flexibility of residential microgrids within active distribution networks: Advancing toward smart cities

Energy Management for Hybrid AC/DC Distribution System With Microgrid Clusters Using Non-Cooperative Game Theory and Robust Optimization

Reliability of High Renewable Penetration Microgrid Facilitated by Coordination of Air Conditioning System and Cooling Fans

Hierarchical Coordination of Two-Time Scale Microgrids with Supply-Demand Imbalance.

Localized management of distributed flexible energy resources

Bidirectional Pricing and Demand Response for Nanogrids with HVAC Systems

Research on day-ahead transactions between multi-microgrid based on cooperative game model

Consensus + Innovations Approach for Distributed Multiagent Coordination in a Microgrid

Deep Reinforcement Learning Microgrid Optimization Strategy Considering Priority Flexible Demand Side

Control and Communication Protocols Based on Packetized Direct Load Control in Smart Building Microgrids.

Distributed Multi-Step Power Scheduling and Cost Allocation for Cooperative Microgrids.

Demand Control Management in Micro-grids: The Impact of Different Policies and Communication Network Topologies

Coordinated Energy Dispatch of Autonomous Microgrids with Distributed MPC Optimization