Abstract:Nowadays, multi-energy systems are receiving special attention from smart grid community owing to their high flexibility potentials integrating with multiple energy carriers. In this regard, energy hub is known as a flexible and efficient platform to supply energy demands with an acceptable range of affordability and reliability by relying on various energy production, storage and conversion facilities. Given the increasing penetration of renewable energy sources to promote a low-carbon energy transition, accurate economic and environmental assessment of energy hub, along with the real-time automatic energy management scheme has become a challenging task due to the high variability of renewable energy sources. Furthermore, the conventional model-based optimization approach requiring full knowledge of the employed mathematical operating models and accurate uncertainty distributions may become impractical for real-world applications. In this context, this paper proposes a model-free safe deep reinforcement learning method for the optimal control of a renewable-based energy hub operating in multiple energy carries while satisfying the physical constraints within the energy hub operation model. The main objective of this work is to minimize the system energy cost and carbon emission by considering various energy components. The proposed deep reinforcement learning method is trained and tested on a real-world dataset to validate its superior performance in reducing energy cost, carbon emission, and computational time with respect to the state-of-the-art deep reinforcement learning and optimized-based approaches. Moreover, the effectiveness of the proposed method in dealing with model operation constraints is evaluated on both training and test environments. Finally, the generalization performance for the learnt energy management scheme as well as the sensitivity analysis on storage flexibility and carbon price are also examined in the case studies.

A Novel Hybrid-Action-Based Deep Reinforcement Learning for Industrial Energy Management

Energy management based on multi-agent deep reinforcement learning for a multi-energy industrial park

An Integrated Demand Response-Based Energy Management Strategy for Integrated Energy System Based on Deep Reinforcement Learning

Deep Reinforcement Learning for Real-Time Energy Management in Smart Home

A hybrid deep learning-based online energy management scheme for industrial microgrid

Safe Reinforcement Learning for Real-Time Automatic Control in a Smart Energy-Hub

A deep reinforcement learning approach to energy management control with connected information for hybrid electric vehicles

Multi-agent deep reinforcement learning based demand response for discrete manufacturing systems energy management

A Novel Model-Free Deep Reinforcement Learning Framework for Energy Management of a PV Integrated Energy Hub

An adaptive hierarchical energy management strategy for hybrid electric vehicles combining heuristic domain knowledge and data-driven deep reinforcement learning

A Multi-Agent Deep Constrained Q-Learning Method for Smart Building Energy Management Under Uncertainties

Optimization strategy based on deep reinforcement learning for home energy management

Towards Pareto-optimal energy management in integrated energy systems: A multi-agent and multi-objective deep reinforcement learning approach

Deep Reinforcement Learning based Energy Management for Heavy Duty HEV considering Discrete-Continuous Hybrid Action Space

Reinforcement learning-based intelligent energy management architecture for hybrid construction machinery

Coordinated energy management for integrated energy system incorporating multiple flexibility measures of supply and demand sides: A deep reinforcement learning approach

Real-time Energy Management of a Low-Carbon Micro-Grid Based on Deep Reinforcement Learning

Interior-point policy optimization based multi-agent deep reinforcement learning method for secure home energy management under various uncertainties

Human-like Energy Management Based on Deep Reinforcement Learning and Historical Driving Experiences

A Data-Driven Reinforcement Learning Based Energy Management Strategy via Bridging Offline Initialization and Online Fine-Tuning for a Hybrid Electric Vehicle

Data-driven optimal energy management for a wind-solar-diesel-battery-reverse osmosis hybrid energy system using a deep reinforcement learning approach