Abstract:As massive distributed energy resources are connected to the distribution networks, the distribution networks are gradually transforming into active distribution networks, and the transmission and distribution networks become more coupled. To make the most of these distributed energy resources and improve the safety of the coupled power system, coordinated real-time power dispatch is indispensable. And for privacy protection and actual engineering needs, the real-time power dispatch problem should be optimized in a decentralized manner by different control centers. In this paper, we decompose the global objective function into local ones, which can be locally optimized by control centers of transmission and distribution networks. The coordination is then realized by introducing the alternating direction method of multipliers (ADMM). Based on the decomposition, we design a novel communication architecture, in which only the boundary variables are exchanged, effectively protecting private information. Additionally, in the real power system, the transmission networks have credible models, while the maintenance of accurate models for distribution networks is usually unaffordable. Therefore, this paper also proposes a hybrid real-time power dispatch method: a model-based optimization method for the transmission network and model-free deep reinforcement learning for each subordinate distribution network. This hybrid method not only overcomes the model incompleteness of the distribution networks but also accelerates and stabilizes the learning process. Numerical test results on three different cases justify the effectiveness of the proposed communication architecture and hybrid real-time power dispatch method.

An advanced real-time dispatching strategy for a distributed energy system based on the reinforcement learning algorithm

Dynamic Energy Dispatch Strategy for Integrated Energy System Based on Improved Deep Reinforcement Learning

Real-time Economic Dispatch of Thermal-Wind-Battery Hybrid Systems Based on Deep Reinforcement Learning

Two-stage Dispatching for Urban Integrated Energy System Considering Uncertainty and Interactive Power

Optimal dispatch of integrated energy system based on deep reinforcement learning

Optimal dispatch of an integrated energy system based on deep reinforcement learning considering new energy uncertainty

An Online Rolling Dispatch Optimization Strategy for the Access of Intermittent New Energy

An Improved Deep Reinforcement Learning Method for Dispatch Optimization Strategy of Modern Power Systems

Real-time dispatch of an integrated energy system based on multi-stage reinforcement learning with an improved action-choosing strategy

Data-driven Optimal Dynamic Dispatch for Hydro-PV-PHS Integrated Power Systems Using Deep Reinforcement Learning Approach

Coordinated Optimal Dispatch for Active Distribution Network under Multi-Time Scales

Dynamic Economic Dispatch of Thermal-Wind-Storage Systems Based on Reinforcement Learning

Joint Optimization Dispatching for Hybrid Power System Based on Deep Reinforcement Learning

Dynamic energy dispatch strategy for integrated energy system based on constrained reinforcement learning

Stochastic dispatch of energy storage in microgrids: An augmented reinforcement learning approach

Coordinated real-time power dispatch for integrated transmission and distribution networks based on model-based optimization and deep reinforcement learning

An adaptive active power rolling dispatch strategy for high proportion of renewable energy based on distributed deep reinforcement learning

Stochastic Dispatch of Energy Storage in Microgrids: A Reinforcement Learning Approach Incorporated with MCTS

Adaptive Robust Method for Dynamic Economic Emission Dispatch Incorporating Renewable Energy and Energy Storage.

Multi-Time Scale Optimal Dispatch for AC/DC Distribution Networks Based on a Markov Chain Dynamic Scenario Method and MPC

Hierarchical and Distributed Optimal Dispatch for Coupled Transmission and Distribution Systems Considering Wind Power Uncertainty