Abstract:Nowadays, multi-energy systems are receiving special attention from smart grid community owing to their high flexibility potentials integrating with multiple energy carriers. In this regard, energy hub is known as a flexible and efficient platform to supply energy demands with an acceptable range of affordability and reliability by relying on various energy production, storage and conversion facilities. Given the increasing penetration of renewable energy sources to promote a low-carbon energy transition, accurate economic and environmental assessment of energy hub, along with the real-time automatic energy management scheme has become a challenging task due to the high variability of renewable energy sources. Furthermore, the conventional model-based optimization approach requiring full knowledge of the employed mathematical operating models and accurate uncertainty distributions may become impractical for real-world applications. In this context, this paper proposes a model-free safe deep reinforcement learning method for the optimal control of a renewable-based energy hub operating in multiple energy carries while satisfying the physical constraints within the energy hub operation model. The main objective of this work is to minimize the system energy cost and carbon emission by considering various energy components. The proposed deep reinforcement learning method is trained and tested on a real-world dataset to validate its superior performance in reducing energy cost, carbon emission, and computational time with respect to the state-of-the-art deep reinforcement learning and optimized-based approaches. Moreover, the effectiveness of the proposed method in dealing with model operation constraints is evaluated on both training and test environments. Finally, the generalization performance for the learnt energy management scheme as well as the sensitivity analysis on storage flexibility and carbon price are also examined in the case studies.

Deep data fusion model for risk perception and coordinated control of smart grid

A Shared Control Approach for Muti-Area Interconnected Power System Via Operational Behaviors Learning

A Bayesian Deep Reinforcement Learning-Based Resilient Control for Multi-Energy Micro-Gird

Data-Enabled Finite Control-Set Model Predictive Control of a Grid-Tied Inverter

A Fusion Framework Using Integrated Neural Network Model for Non-Intrusive Load Monitoring

Toward Intelligent Emergency Control for Large-scale Power Systems: Convergence of Learning, Physics, Computing and Control

Safe Reinforcement Learning for Real-Time Automatic Control in a Smart Energy-Hub

Deep Reinforcement Learning for Load Frequency Control in Isolated Microgrids: A Knowledge Aggregation Approach with Emphasis on Power Symmetry and Balance

A Holistic Power Optimization Approach for Microgrid Control Based on Deep Reinforcement Learning

Supervised assisted deep reinforcement learning for emergency voltage control of power systems

Multi Energy Coordinative Optimization Technology and Application for Northwest China Power Grid

An Effective Data Fusion Model for Detecting the Risk of Transmission Line in Smart Grid

Real-time emergency load shedding for power system transient stability control: A risk-averse deep learning method

Real-Time Load Forecasting and Adaptive Control in Smart Grids Using a Hybrid Neuro-Fuzzy Approach

Deep learning-driven hybrid model for short-term load forecasting and smart grid information management

Adaptive Power System Emergency Control using Deep Reinforcement Learning

A Deep Learning Approach for Power System Knowledge Discovery Based on Multitask Learning

Learning-Aided Framework for Storage Control Facing Renewable Energy

CuEMS: Deep reinforcement learning for community control of energy management systems in microgrids

A prior knowledge-embedded reinforcement learning method for real-time active power corrective control in complex power systems

Multi-source Heterogeneous Information Fusion of Power Assets Based on Knowledge Graph