Abstract:With the development of energy Internet and intelligent buildings, the interactions of supply and demand sides of integrated energy system (IES) offer an attractive route for flexible energy management in buildings. However, traditional model-based control methods over-rely on precise mathematical modeling, difficult to flexibly deal with complex and changeable operating environments of IES. Therefore, this work proposes a coordinated operation optimization framework based on the deep reinforcement learning (DRL) algorithm for optimal scheduling of IES. Firstly, two supply-side and three demand-side flexibility measures are considered to tap the potential of flexible scheduling, including active adjustment of energy conversion equipment, energy storage, incentive-based demand response, electric vehicles and thermal inertia of building. Secondly, the coordinated optimization is formulated as a partially-observable Markov decision process. The twin delayed deep deterministic policy (TD3) algorithm is employed to solve the optimal energy management problem of IES, aiming at operation cost and user satisfaction. Thirdly, a hierarchical reward shaping (HRS) mechanism is proposed to improve the training performance of DRL, which could evaluate the current and final performance of agent and return the underway reward at each step and final reward. The developed optimization methodology is used for a case study in the building. The results show that the proposed HRS-TD3 algorithm achieves the fastest convergence and has the best economic performance compared with the other baseline algorithms. The operation cost of coordinated optimization is superior to those of the three baseline scenarios and achieves an improvement of 33.1%, 3.5% and 29.8%, respectively.

Energy-aware Task Scheduling Optimization with Deep Reinforcement Learning for Large-Scale Heterogeneous Systems

Energy-aware systems for real-time job scheduling in cloud data centers: A deep reinforcement learning approach

RARE: Renewable Energy Aware Resource Management in Datacenters

Optimizing Data Centre Energy Efficiency via Event-Driven Deep Reinforcement Learning

Deep reinforcement learning-based resource scheduling for energy optimization and load balancing in SDN-driven edge computing

Performance Comparison of Deep RL Algorithms for Energy Systems Optimal Scheduling

Energy efficient task scheduling based on deep reinforcement learning in cloud environment: A specialized review

Optimal Energy System Scheduling Using A Constraint-Aware Reinforcement Learning Algorithm

The Optimized Reinforcement Learning Approach to Run-Time Scheduling in Data Center.

Deep Reinforcement Learning-Based Workload Scheduling for Edge Computing

Reinforcement Learning for Adaptive Resource Scheduling in Complex System Environments

Deep Reinforcement Learning for Real-Time Energy Management in Smart Home

Coordinated energy management for integrated energy system incorporating multiple flexibility measures of supply and demand sides: A deep reinforcement learning approach

Hierarchical deep reinforcement learning for self-adaptive economic dispatch

A2C-DRL: Dynamic Scheduling for Stochastic Edge-Cloud Environments Using A2C and Deep Reinforcement Learning

Data-Driven Online Energy Scheduling of a Microgrid Based on Deep Reinforcement Learning

Real-time optimization of large-scale hydrogen production systems using off-grid renewable energy: Scheduling strategy based on deep reinforcement learning

Optimal Planning of Hybrid Energy Storage Systems using Curtailed Renewable Energy through Deep Reinforcement Learning

HeterPS: Distributed deep learning with reinforcement learning based scheduling in heterogeneous environments

Deep Reinforcement Learning-driven Cross-Community Energy Interaction Optimal Scheduling

Stacked Autoencoder-Based Deep Reinforcement Learning for Online Resource Scheduling in Large-Scale MEC Networks