Abstract:Nowadays, multi-energy systems are receiving special attention from smart grid community owing to their high flexibility potentials integrating with multiple energy carriers. In this regard, energy hub is known as a flexible and efficient platform to supply energy demands with an acceptable range of affordability and reliability by relying on various energy production, storage and conversion facilities. Given the increasing penetration of renewable energy sources to promote a low-carbon energy transition, accurate economic and environmental assessment of energy hub, along with the real-time automatic energy management scheme has become a challenging task due to the high variability of renewable energy sources. Furthermore, the conventional model-based optimization approach requiring full knowledge of the employed mathematical operating models and accurate uncertainty distributions may become impractical for real-world applications. In this context, this paper proposes a model-free safe deep reinforcement learning method for the optimal control of a renewable-based energy hub operating in multiple energy carries while satisfying the physical constraints within the energy hub operation model. The main objective of this work is to minimize the system energy cost and carbon emission by considering various energy components. The proposed deep reinforcement learning method is trained and tested on a real-world dataset to validate its superior performance in reducing energy cost, carbon emission, and computational time with respect to the state-of-the-art deep reinforcement learning and optimized-based approaches. Moreover, the effectiveness of the proposed method in dealing with model operation constraints is evaluated on both training and test environments. Finally, the generalization performance for the learnt energy management scheme as well as the sensitivity analysis on storage flexibility and carbon price are also examined in the case studies.

Experimental Validation for Distributed Control of Energy Hubs

Distributed Optimal Control of Energy Hubs for Micro-Integrated Energy Systems

Distributed Multi-Horizon Model Predictive Control for Network of Energy Hubs

Distributed Real-Time Multi-Objective Control of a Virtual Power Plant in DC Distribution Systems

Grid-aware Distributed Model Predictive Control of Heterogeneous Resources in a Distribution Network: Theory and Experimental Validation

Optimal and distributed energy management in interconnected energy hubs

Safe Reinforcement Learning for Real-Time Automatic Control in a Smart Energy-Hub

Modeling And Optimal Operation Of A Network Of Energy Hubs System With Distributed Energy Resources

Incorporating forecasting and peer-to-peer negotiation frameworks into a distributed model predictive control approach for meshed electric networks

Distributed model predictive control of buildings and energy hubs

Experimental Validation of Fully Distributed Peer-to-Peer Optimal Voltage Control with Minimal Model Requirements

Distributed Energy Management for an Energy Hub with Multi-users under Imperfect Communication

Optimization of energy hub interactions using congestion games in distributed load response programs

Stochastic MPC for energy hubs using data driven demand forecasting

Robust Real-Time Distributed Optimal Control Based Energy Management in a Smart Grid

Optimal robust collaborative management of multiple EHs in power systems by utilizing the game theory

A hierarchical distributed predictive control approach for microgrids energy management

A Multi-Agent Deep Reinforcement Learning Approach Enabled Distributed Energy Management Schedule for the Coordinate Control of Multi-Energy Hub with Gas, Electricity, and Freshwater

Distributed Model Predictive Control for Energy Systems in Microgrids

Coordinated distributed model predictive control for multi energy carrier systems

Analyzing and Validating the Economic Efficiency of Managing a Cluster of Energy Hubs in Multi-Carrier Energy Systems