Abstract:Deep reinforcement learning (DRL) control methods have shown great potential for optimal HVAC control, but they require significant time and data to learn effective policies. By employing transfer learning (TL) with pre-trained models, the need to learn the data from scratch is avoided, saving time and resources. However, there are two main critical issues with this approach: the inappropriate selection of the source domain resulting in worse control performance and inefficient utilization of multi-source domain control experience. To address these challenges, a multi-source transfer learning and deep reinforcement learning (MTL-DRL) integrated framework is proposed for efficient HVAC system control. In order to select appropriate source domains, the contribution of various source domains to the target task is quantified first, followed by a comprehensive evaluation of transfer performance based on average energy consumption and average temperature deviation. The well-pretrained DRL parameters from the optimal multi-source transfer set are then sequentially transferred to the target DRL controller. Results from a series of transfer experiments between buildings with different thermal zones and weather conditions indicate that the MTL-DRL framework significantly reduces the training time of HVAC control, with improvements of up to 20% compared to DRL baseline models trained from scratch. Additionally, the MTL-DRL method leads to reductions in average energy consumption ranging from 1.43% to 3.12% and average temperature deviation up to 14.32%. The impact of the source domain transfer sequence on the performance of the DRL-based control method is also discussed. Overall, the proposed framework presents a promising solution for enhancing DRL-based HVAC control methods by reducing training time and energy consumption while maintaining occupants' comfort.

Frequency Provision Through Two-Timescale Commercial Building HVAC System Control Using Hierarchical Reinforcement Learning

Hierarchical Control of Air-Conditioning Loads for Flexible Demand Response in the Short Term.

Laxity-Aware Scalable Reinforcement Learning for HVAC Control

Hybrid-Model-Based Deep Reinforcement Learning for Heating, Ventilation, and Air-Conditioning Control

Modelling building HVAC control strategies using a deep reinforcement learning approach

Multi-Agent Deep Reinforcement Learning for HVAC Control in Commercial Buildings

Multi-source transfer learning method for enhancing the deployment of deep reinforcement learning in multi-zone building HVAC control

Intelligent multi-zone residential HVAC control strategy based on deep reinforcement learning

Multi-zone HVAC Control with Model-Based Deep Reinforcement Learning

Comparative study of model-based and model-free reinforcement learning control performance in HVAC systems

Optimizing Industrial HVAC Systems with Hierarchical Reinforcement Learning

Distributed Multi-Agent Deep Reinforcement Learning Framework for Whole-building HVAC Control

Enhancing the Performance of Multi-Agent Reinforcement Learning for Controlling HVAC Systems

Multi-Objective Control of Residential HVAC Loads for Balancing the User's Comfort With the Frequency Regulation Performance

Optimal Control Strategy for Building HVAC Systems: Satisfying Flexible Demand Response with Different Value-Based Selection

Evaluation of Frequency Regulation Provision by Commercial Building HVAC Systems

Multi-Objective Control of Residential HVAC Loads for Balancing the User’s Comfort With the Frequency Regulation Performance

A hybrid control strategy for frequency regulation with variable refrigerant flow air conditioning system

MBRL-MC: An HVAC Control Approach via Combining Model-based Deep Reinforcement Learning and Model Predictive Control

Energy-Efficient HVAC Control Based on Reinforcement Learning and Transfer Learning in a Residential Building

A Community Energy Management Method Based on Explainable Reinforcement Learning