Abstract:The central air conditioning system accounts for 50% of the building energy consumption, and the cold source system accounts for more than 60% of the total energy consumption of the central air conditioning system. Therefore, it is crucial to solve the optimal control strategy of the cold source system according to the cooling load demand, and adjust the operating parameters in time to achieve low energy consumption and high efficiency. Due to the complex and changeable characteristics of the central air conditioning system, it is often difficult to achieve ideal results using traditional control methods. In order to solve this problem, this study first coupled the building cooling load simulation environment and the cold source system simulation environment to build a central air conditioning system simulation environment. Secondly, noise interference was introduced to reduce the gap between the simulated environment and the actual environment, and improve the robustness of the environment. Finally, combined with deep reinforcement learning, an optimal control strategy for the central air conditioning system is proposed. Aiming at the simulation environment of the central air conditioning system, a new model-free algorithm is proposed, called the dominant function upper confidence bound deep Q-network (AFUCB-DQN). The algorithm combines the advantages of an advantage function and an upper confidence bound algorithm to balance the relationship between exploration and exploitation, so as to achieve a better control strategy search. Compared with the traditional deep Q-network (DQN) algorithm, double deep Q-network (DDQN) algorithm, and the distributed double deep Q-network (D3QN) algorithm, the AFUCB-DQN algorithm has more stable convergence, faster convergence speed, and higher reward. In this study, significant energy savings of 21.5%, 21.4%, and 22.3% were obtained by conducting experiments at indoor thermal comfort levels of 24 °C, 25 °C, and 26 °C in the summer.

DDQN-based data laboratory energy consumption control model

A Cfd-Based Test Method For Control Of Indoor Environment In Air-Conditioned Rooms

A multi-setpoint cooling control approach for air-cooled data centers using the deep Q-network algorithm

Artificial Intelligence-Based Temperature Twinning and Pre-Control for Data Center Airflow Organization

Optimizing Energy Efficiency for Data Center via Parameterized Deep Reinforcement Learning

Optimization Control Strategy for a Central Air Conditioning System Based on AFUCB-DQN

Transforming Cooling Optimization for Green Data Center via Deep Reinforcement Learning

Energy Consumption Optimization for Heating, Ventilation and Air Conditioning Systems Based on Deep Reinforcement Learning

Augmented Data Center Infrastructure Management System for Minimizing Energy Consumption

ED-DQN: An event-driven deep reinforcement learning control method for multi-zone residential buildings

An energy-environment coupled simulation framework for multi-scale and multi-facet evaluation of data center

IoT-based Data Collection System for Central Air Conditioning

A Data-Driven Method for the Optimal Control of Centralized Cooling Station in an Office Park

Design and Key Technology of the Energy Consumption Management System for the Liquid Cooling Data Center

Multi-dimensional analysis of air-conditioning energy use for energy-saving management in university teaching buildings

Towards Optimal HVAC Control in Non-Stationary Building Environments Combining Active Change Detection and Deep Reinforcement Learning

Multi-scale collaborative modeling and deep learning-based thermal prediction for air-cooled data centers: An innovative insight for thermal management

A neural-network enhanced modeling method for real-time evaluation of the temperature distribution in a data center

The impact of deep learning–based equipment usage detection on building energy demand estimation

A short-term building energy consumption prediction and diagnosis using deep learning algorithms

Convolutional Neural Network Based Energy Consumption Management Model for the Full Life Cycle of Buildings and Information System Design