Abstract:Heating, ventilation, and air conditioning (HVAC) energy consumption now accounts for a major portion of energy use for buildings. Therefore, finding the optimal energy-saving control strategy for HVAC systems to optimize energy consumption has become crucial in realizing energy savings, emission reductions, and green buildings. Traditional methods for HVAC parameter control require complex physical model calculation; continuous and coupled parameters are handled poorly. Developing deep reinforcement learning (DRL) methods provides new ideas for HVAC energy consumption optimization. Herein, a DRL-based energy consumption optimization framework for HVAC systems is proposed. First, an HVAC system energy consumption prediction model based on a convolutional neural network–long short-term memory (CNN-LSTM) network is suggested to approximate the real world. This model solves the efficiency problem of energy consumption prediction while also providing highly accurate predictions of HVAC energy consumption. We propose an enhanced deep deterministic policy gradient (E-DDPG) energy consumption optimization algorithm for HVAC systems based on an improved training strategy to obtain the best real-time energy consumption control strategy for HVAC systems. Finally, experiments using real-world building HVAC control data sets were conducted to evaluate our models. The experiments show that the CNN–LSTM model for HVAC system energy consumption prediction outperforms baseline models while reducing training time by 42.9%. Compared to the baseline algorithm, the E-DDPG algorithm using an improved training strategy requires 20% fewer iterations for convergence, has a 14.8% narrower fluctuation interval during the training process, and improves the energy efficiency ratio of HVAC systems by 49%.

A novel deep reinforcement learning based methodology for short-term HVAC system energy consumption prediction

Energy Consumption Optimization for Heating, Ventilation and Air Conditioning Systems Based on Deep Reinforcement Learning

Energy Saving Algorithm of HVAC System Based on Deep Reinforcement Learning with Modelica Model

Hybrid-Model-Based Deep Reinforcement Learning for Heating, Ventilation, and Air-Conditioning Control

A novel building energy consumption prediction method using deep reinforcement learning with consideration of fluctuation points

USING DEEP LEARNING TO OPTIMIZE HVAC SYSTEMS IN RESIDENTIAL BUILDINGS

Intelligent multi-zone residential HVAC control strategy based on deep reinforcement learning

A Building Energy Consumption Prediction Method Based on Integration of a Deep Neural Network and Transfer Reinforcement Learning

Deep Reinforcement Learning for Smart Home Energy Management

Heating ventilation air‐conditioner system for multi‐regional commercial buildings based on deep reinforcement learning

Building Energy Consumption Prediction Using a Deep-Forest-Based DQN Method

Energy-Efficient HVAC Control Based on Reinforcement Learning and Transfer Learning in a Residential Building

Modelling building HVAC control strategies using a deep reinforcement learning approach

An experimental evaluation of deep reinforcement learning algorithms for HVAC control

MF^2: Model-free Reinforcement Learning for Modeling-Free Building HVAC Control with Data-Driven Environment Construction in a Residential Building

Deep Reinforcement Learning for Real-Time Energy Management in Smart Home

Reinforcement Learning-Based Auto-Optimized Parallel Prediction for Air Conditioning Energy Consumption

A Community Energy Management Method Based on Explainable Reinforcement Learning

An energy consumption prediction method for HVAC systems using energy storage based on time series shifting and deep learning

Data-driven predictive control for smart HVAC system in IoT-integrated buildings with time-series forecasting and reinforcement learning

Successful application of predictive information in deep reinforcement learning control: A case study based on an office building HVAC system