Abstract:Heating, ventilation, and air conditioning (HVAC) energy consumption now accounts for a major portion of energy use for buildings. Therefore, finding the optimal energy-saving control strategy for HVAC systems to optimize energy consumption has become crucial in realizing energy savings, emission reductions, and green buildings. Traditional methods for HVAC parameter control require complex physical model calculation; continuous and coupled parameters are handled poorly. Developing deep reinforcement learning (DRL) methods provides new ideas for HVAC energy consumption optimization. Herein, a DRL-based energy consumption optimization framework for HVAC systems is proposed. First, an HVAC system energy consumption prediction model based on a convolutional neural network–long short-term memory (CNN-LSTM) network is suggested to approximate the real world. This model solves the efficiency problem of energy consumption prediction while also providing highly accurate predictions of HVAC energy consumption. We propose an enhanced deep deterministic policy gradient (E-DDPG) energy consumption optimization algorithm for HVAC systems based on an improved training strategy to obtain the best real-time energy consumption control strategy for HVAC systems. Finally, experiments using real-world building HVAC control data sets were conducted to evaluate our models. The experiments show that the CNN–LSTM model for HVAC system energy consumption prediction outperforms baseline models while reducing training time by 42.9%. Compared to the baseline algorithm, the E-DDPG algorithm using an improved training strategy requires 20% fewer iterations for convergence, has a 14.8% narrower fluctuation interval during the training process, and improves the energy efficiency ratio of HVAC systems by 49%.

Direct Thermal Load Control in Active Distribution Networks Based on Deep Reinforcement Learning

A Game-Theoretic Approach to Decentralized Control of Heterogeneous Load Population

Intelligent multi-zone residential HVAC control strategy based on deep reinforcement learning

DDPG-based Reactive Power Optimization Strategy for Active Distribution Network

Hybrid-Model-Based Deep Reinforcement Learning for Heating, Ventilation, and Air-Conditioning Control

District Cooling System Control for Providing Operating Reserve Based on Safe Deep Reinforcement Learning

Reinforcement Learning-based District Cooling System Control for Voltage Regulation in Distribution Networks.

Learning a Distributed Control Scheme for Demand Flexibility in Thermostatically Controlled Loads

Direct Load Control by Distributed Imperialist Competitive Algorithm

A Distributed ADMM-based Deep Learning Approach for Thermal Control in Multi-Zone Buildings under Demand Response Events

Towards Optimal District Heating Temperature Control in China with Deep Reinforcement Learning

Energy Consumption Optimization for Heating, Ventilation and Air Conditioning Systems Based on Deep Reinforcement Learning

Energy-Efficient Thermal Comfort Control in Smart Buildings via Deep Reinforcement Learning

ED-DQN: An event-driven deep reinforcement learning control method for multi-zone residential buildings

Reinforcement learning of room temperature set-point of thermal storage air-conditioning system with demand response

Distributed Multi-Agent Deep Reinforcement Learning Framework for Whole-building HVAC Control

Modelling building HVAC control strategies using a deep reinforcement learning approach

Reinforcement Learning-Based Net Load Volatility Control of Active Distribution Power Networks

Intelligent control of district heating system based on RDPG

Energy-Efficient HVAC Control Based on Reinforcement Learning and Transfer Learning in a Residential Building

Deep Reinforcement Learning-Based Demand Response for Smart Facilities Energy Management