Abstract:The development of distributed renewable energy resources and smart energy management are efficient approaches to decarbonizing building energy systems. Reinforcement learning (RL) is a data-driven control algorithm that trains a large amount of data to learn control policy. However, this learning process generally presents low learning efficiency using real-world stochastic data. To address this challenge, this study proposes a model-based RL approach to optimize the operation of existing zero-energy houses considering PV generation consumption and energy costs. The model-based approach takes advantage of the inner understanding of the system dynamics; this knowledge improves the learning efficiency. A reward function is designed considering the physical constraints of battery storage, photovoltaic (PV) production feed-in profit, and energy cost. Measured data of a zero-energy house are used to train and test the proposed RL agent control, including Q-learning, deep Q network (DQN), and deep deterministic policy gradient (DDPG) agents. The results show that the proposed RL agents can achieve fast convergence during the training process. In comparison with the rule-based strategy, test cases verify the cost-effectiveness performances of proposed RL approaches in scheduling operations of the hybrid energy system under different scenarios. The comparative analysis of test periods shows that the DQN agent presents better energy cost-saving performances than Q-learning while the Q-learning agent presents more flexible action control of the battery with the fluctuation of real-time electricity prices. The DDPG algorithm can achieve the highest PV self-consumption ratio, 49.4%, and the self-sufficiency ratio reaches 36.7%. The DDPG algorithm outperforms rule-based operation by 7.2% for energy cost during test periods.

Adaptive Optimization Design of Building Energy System for Smart Elderly Care Community Based on Deep Deterministic Policy Gradient

Optimization strategy based on deep reinforcement learning for home energy management

DDPG-based Reactive Power Optimization Strategy for Active Distribution Network

Optimization Effectiveness of Multi-Intelligence Consistent Energy System Based on Digital Advertising and Data Analysis

Deep Reinforcement Learning for Smart Home Energy Management

Deep Reinforcement Learning for Real-Time Energy Management in Smart Home

A data-driven DRL-based home energy management system optimization framework considering uncertain household parameters

On-line Building Energy Optimization using Deep Reinforcement Learning

Soft actor-critic –based multi-objective optimized energy conversion and management strategy for integrated energy systems with renewable energy

Optimizing a domestic battery and solar photovoltaic system with deep reinforcement learning

ADPA Optimization for Real-Time Energy Management Using Deep Learning

Intelligent multi-zone residential HVAC control strategy based on deep reinforcement learning

Towards Pareto-optimal energy management in integrated energy systems: A multi-agent and multi-objective deep reinforcement learning approach

A Multi-Agent Deep Constrained Q-Learning Method for Smart Building Energy Management Under Uncertainties

Optimizing Energy Efficiency for Data Center via Parameterized Deep Reinforcement Learning

A Holistic Power Optimization Approach for Microgrid Control Based on Deep Reinforcement Learning

Energy-Efficient Thermal Comfort Control in Smart Buildings via Deep Reinforcement Learning

Coordinated energy management for integrated energy system incorporating multiple flexibility measures of supply and demand sides: A deep reinforcement learning approach

Hierarchical Rewarding Deep Deterministic Policy Gradient Strategy for Energy Management of Hybrid Electric Vehicles

Real-time optimization of large-scale hydrogen production systems using off-grid renewable energy: Scheduling strategy based on deep reinforcement learning

Performance Assessment and Comparative Analysis of Photovoltaic-Battery System Scheduling in an Existing Zero-Energy House Based on Reinforcement Learning Control