Abstract:Reliable and accurate building energy consumption prediction is becoming increasingly pivotal in building energy management. Currently, data-driven approach has shown promising performances and gained lots of research attention due to its efficiency and flexibility. As a combination of reinforcement learning and deep learning, deep reinforcement learning (DRL) techniques are expected to solve nonlinear and complex issues. However, very little is known about DRL techniques in forecasting building energy consumption. Therefore, this paper presents a case study of an office building using three commonly-used DRL techniques to forecast building energy consumption, namely Asynchronous Advantage Actor-Critic (A3C), Deep Deterministic Policy Gradient (DDPG) and Recurrent Deterministic Policy Gradient (RDPG). The objective is to investigate the potential of DRL techniques in building energy consumption prediction field. A comprehensive comparison between DRL models and common supervised models is also provided.The results demonstrate that the proposed DDPG and RDPG models have obvious advantages in forecasting building energy consumption compared to common supervised models, while accounting for more computation time for model training. Their prediction performances measured by mean absolute error (MAE) can be improved by 16%-24% for single-step ahead prediction, and 19%-32% for multi-step ahead prediction. The results also indicate that A3C performs poor prediction accuracy and shows much slower convergence speed than DDPG and RDPG. However, A3C is still the most efficient technique among these three DRL methods. The findings are enlightening and the proposed DRL methodologies can be positively extended to other prediction problems, e.g., wind speed prediction and electricity load prediction.

Deep Reinforcement Learning for Smart Building Energy Management: A Survey.

A Review of Deep Reinforcement Learning for Smart Building Energy Management

A review of reinforcement learning for controlling Building Energy Systems from a computer science perspective

Exploring Deep Reinforcement Learning for Holistic Smart Building Control

Energy Management of Intelligent Building Based on Deep Reinforced Learning

A Novel Two-stage Reinforcement Learning Framework for Sustainable Building Energy Management Systems

Applications of reinforcement learning for building energy efficiency control: A review

Multi-agent reinforcement learning dealing with hybrid action spaces: A case study for off-grid oriented renewable building energy system

Data-driven Model Predictive and Reinforcement Learning Based Control for Building Energy Management: a Survey

Simulation Studies on Deep Reinforcement Learning for Building Control with Human Interaction

A review of reinforcement learning for autonomous building energy management

Deep Reinforcement Learning for Intelligent Energy Management Systems of Hybrid-Electric Powertrains: Recent Advances, Open Issues, and Prospects

Real building implementation of a deep reinforcement learning controller to enhance energy efficiency and indoor temperature control

Model-Free Real-Time Autonomous Energy Management for a Residential Multi-Carrier Energy System: A Deep Reinforcement Learning Approach

Study on deep reinforcement learning techniques for building energy consumption forecasting

Deep Reinforcement Learning for Smart Home Energy Management

Deep Reinforcement Learning for Real-Time Energy Management in Smart Home

Energy-Efficient HVAC Control Based on Reinforcement Learning and Transfer Learning in a Residential Building

Energy-Efficient Thermal Comfort Control in Smart Buildings via Deep Reinforcement Learning

MetaEMS: A Meta Reinforcement Learning-based Control Framework for Building Energy Management System

Review of Home Energy Management Systems Based on Deep Reinforcement Learning