Abstract:Nowadays, multi-energy systems are receiving special attention from smart grid community owing to their high flexibility potentials integrating with multiple energy carriers. In this regard, energy hub is known as a flexible and efficient platform to supply energy demands with an acceptable range of affordability and reliability by relying on various energy production, storage and conversion facilities. Given the increasing penetration of renewable energy sources to promote a low-carbon energy transition, accurate economic and environmental assessment of energy hub, along with the real-time automatic energy management scheme has become a challenging task due to the high variability of renewable energy sources. Furthermore, the conventional model-based optimization approach requiring full knowledge of the employed mathematical operating models and accurate uncertainty distributions may become impractical for real-world applications. In this context, this paper proposes a model-free safe deep reinforcement learning method for the optimal control of a renewable-based energy hub operating in multiple energy carries while satisfying the physical constraints within the energy hub operation model. The main objective of this work is to minimize the system energy cost and carbon emission by considering various energy components. The proposed deep reinforcement learning method is trained and tested on a real-world dataset to validate its superior performance in reducing energy cost, carbon emission, and computational time with respect to the state-of-the-art deep reinforcement learning and optimized-based approaches. Moreover, the effectiveness of the proposed method in dealing with model operation constraints is evaluated on both training and test environments. Finally, the generalization performance for the learnt energy management scheme as well as the sensitivity analysis on storage flexibility and carbon price are also examined in the case studies.

A Human-Machine Reinforcement Learning Method for Cooperative Energy Management.

Model-Free Real-Time Autonomous Energy Management for a Residential Multi-Carrier Energy System: A Deep Reinforcement Learning Approach

A Multi-Agent Deep Constrained Q-Learning Method for Smart Building Energy Management Under Uncertainties

Deep Reinforcement Learning for Real-Time Energy Management in Smart Home

Deep reinforcement learning based home energy management system with devices operational dependencies

Physical model-assisted deep reinforcement learning for energy management optimization of industrial electric-hydrogen coupling system with hybrid energy storage

Safe Reinforcement Learning for Real-Time Automatic Control in a Smart Energy-Hub

Artificial Intelligence Based Smart Energy Community Management: A Reinforcement Learning Approach

Autonomous Household Energy Management Using Deep Reinforcement Learning

Physical-model-free intelligent energy management for a grid-connected hybrid wind-microturbine-PV-EV energy system via deep reinforcement learning approach

Real-Time Energy Management of a Microgrid Using Deep Reinforcement Learning

Efficient learning of power grid voltage control strategies via model-based deep reinforcement learning

Safe Deep Reinforcement Learning for Microgrid Energy Management in Distribution Networks with Leveraged Spatial–Temporal Perception

A Novel Model-Free Deep Reinforcement Learning Framework for Energy Management of a PV Integrated Energy Hub

Mixed Deep Reinforcement Learning Considering Discrete-continuous Hybrid Action Space for Smart Home Energy Management

A Home Energy Management Approach Using Decoupling Value and Policy in Reinforcement Learning

Reinforcement Learning for Fair and Efficient Charging Coordination for Smart Grid

Deep Reinforcement Learning for Stochastic Dynamic Microgrid Energy Management

Operational Optimization for the Grid-Connected Residential Photovoltaic-Battery System Using Model-Based Reinforcement Learning

A Holistic Power Optimization Approach for Microgrid Control Based on Deep Reinforcement Learning

Distributed Energy Management and Demand Response in Smart Grids: A Multi-Agent Deep Reinforcement Learning Framework