Abstract:The built environment sector is responsible for almost one-third of the world's final energy consumption. Hence, seeking plausible solutions to minimise building energy demands and mitigate adverse environmental impacts is necessary. Artificial intelligence (AI) techniques such as machine and deep learning have been increasingly and successfully applied to develop solutions for the built environment. This review provided a critical summary of the existing literature on the machine and deep learning methods for the built environment over the past decade, with special reference to holistic approaches. Different AI-based techniques employed to resolve interconnected problems related to heating, ventilation and air conditioning (HVAC) systems and enhance building performances were reviewed, including energy forecasting and management, indoor air quality and occupancy comfort/satisfaction prediction, occupancy detection and recognition, and fault detection and diagnosis. The present study explored existing AI-based techniques focusing on the framework, methodology, and performance. The literature highlighted that selecting the most suitable machine learning and deep learning model for solving a problem could be challenging. The recent explosive growth experienced by the research area has led to hundreds of machine learning algorithms being applied to building performance-related studies. The literature showed that existing research studies considered a wide range of scope/scales (from an HVAC component to urban areas) and time scales (minute to year). This makes it difficult to find an optimal algorithm for a specific task or case. The studies also employed a wide range of evaluation metrics, adding to the challenge. Further developments and more specific guidelines are required for the built environment field to encourage best practices in evaluating and selecting models. The literature also showed that while machine and deep learning had been successfully applied in building energy efficiency research, most of the studies are still at the experimental or testing stage, and there are limited studies which implemented machine and deep learning strategies in actual buildings and conducted the post-occupancy evaluation.

Applications of reinforcement learning for building energy efficiency control: A review

A review of reinforcement learning for autonomous building energy management

A review of reinforcement learning for controlling Building Energy Systems from a computer science perspective

Deep Reinforcement Learning for Smart Building Energy Management: A Survey.

A Review of Deep Reinforcement Learning for Smart Building Energy Management

Reinforcement learning building control approach harnessing imitation learning

Energy-Efficient HVAC Control Based on Reinforcement Learning and Transfer Learning in a Residential Building

Exploring Deep Reinforcement Learning for Holistic Smart Building Control

Data-driven Model Predictive and Reinforcement Learning Based Control for Building Energy Management: a Survey

Energy-Efficient Thermal Comfort Control in Smart Buildings via Deep Reinforcement Learning

A review of reinforcement learning methodologies for controlling occupant comfort in buildings

Machine Learning and Deep Learning Methods for Enhancing Building Energy Efficiency and Indoor Environmental Quality – A Review

Simulation Studies on Deep Reinforcement Learning for Building Control with Human Interaction

Energy optimization for regional buildings based on distributed reinforcement learning

Comparison of reinforcement learning and model predictive control for building energy system optimization

Reinforcement Learning and Its Applications in Modern Power and Energy Systems: A Review

A Community Energy Management Method Based on Explainable Reinforcement Learning

MetaEMS: A Meta Reinforcement Learning-based Control Framework for Building Energy Management System

A Relearning Approach to Reinforcement Learning for Control of Smart Buildings

An overview of machine learning applications for smart buildings

Advanced controls on energy reliability, flexibility, resilience, and occupant-centric control for smart and energy-efficient buildings—A state-of-the-art review