Abstract:Deep reinforcement learning (DRL) control methods have shown great potential for optimal HVAC control, but they require significant time and data to learn effective policies. By employing transfer learning (TL) with pre-trained models, the need to learn the data from scratch is avoided, saving time and resources. However, there are two main critical issues with this approach: the inappropriate selection of the source domain resulting in worse control performance and inefficient utilization of multi-source domain control experience. To address these challenges, a multi-source transfer learning and deep reinforcement learning (MTL-DRL) integrated framework is proposed for efficient HVAC system control. In order to select appropriate source domains, the contribution of various source domains to the target task is quantified first, followed by a comprehensive evaluation of transfer performance based on average energy consumption and average temperature deviation. The well-pretrained DRL parameters from the optimal multi-source transfer set are then sequentially transferred to the target DRL controller. Results from a series of transfer experiments between buildings with different thermal zones and weather conditions indicate that the MTL-DRL framework significantly reduces the training time of HVAC control, with improvements of up to 20% compared to DRL baseline models trained from scratch. Additionally, the MTL-DRL method leads to reductions in average energy consumption ranging from 1.43% to 3.12% and average temperature deviation up to 14.32%. The impact of the source domain transfer sequence on the performance of the DRL-based control method is also discussed. Overall, the proposed framework presents a promising solution for enhancing DRL-based HVAC control methods by reducing training time and energy consumption while maintaining occupants' comfort.

Hybrid-Model-Based Deep Reinforcement Learning for Heating, Ventilation, and Air-Conditioning Control

A Multi-Step Predictive Deep Reinforcement Learning Algorithm for HVAC Control Systems in Smart Buildings

Optimal Scheduling of Residential Heating, Ventilation and Air Conditioning Based on Deep Reinforcement Learning

Energy Consumption Optimization for Heating, Ventilation and Air Conditioning Systems Based on Deep Reinforcement Learning

Intelligent multi-zone residential HVAC control strategy based on deep reinforcement learning

Towards Various Occupants with Different Thermal Comfort Requirements: A Deep Reinforcement Learning Approach Combined with a Dynamic PMV Model for HVAC Control in Buildings

MBRL-MC: An HVAC Control Approach via Combining Model-based Deep Reinforcement Learning and Model Predictive Control

Modelling building HVAC control strategies using a deep reinforcement learning approach

Energy Saving Algorithm of HVAC System Based on Deep Reinforcement Learning with Modelica Model

ED-DQN: An event-driven deep reinforcement learning control method for multi-zone residential buildings

Distributed Multi-Agent Deep Reinforcement Learning Framework for Whole-building HVAC Control

Heating ventilation air‐conditioner system for multi‐regional commercial buildings based on deep reinforcement learning

Multi-source transfer learning method for enhancing the deployment of deep reinforcement learning in multi-zone building HVAC control

Energy-Efficient HVAC Control Based on Reinforcement Learning and Transfer Learning in a Residential Building

USING DEEP LEARNING TO OPTIMIZE HVAC SYSTEMS IN RESIDENTIAL BUILDINGS

Multi-Agent Deep Reinforcement Learning for HVAC Control in Commercial Buildings

A Safe and Data-efficient Model-based Reinforcement Learning System for HVAC Control

Comparative study of model-based and model-free reinforcement learning control performance in HVAC systems

A Community Energy Management Method Based on Explainable Reinforcement Learning

MF^2: Model-free Reinforcement Learning for Modeling-Free Building HVAC Control with Data-Driven Environment Construction in a Residential Building

A Comparison of Classical and Deep Reinforcement Learning Methods for HVAC Control