Abstract:The central air conditioning system accounts for 50% of the building energy consumption, and the cold source system accounts for more than 60% of the total energy consumption of the central air conditioning system. Therefore, it is crucial to solve the optimal control strategy of the cold source system according to the cooling load demand, and adjust the operating parameters in time to achieve low energy consumption and high efficiency. Due to the complex and changeable characteristics of the central air conditioning system, it is often difficult to achieve ideal results using traditional control methods. In order to solve this problem, this study first coupled the building cooling load simulation environment and the cold source system simulation environment to build a central air conditioning system simulation environment. Secondly, noise interference was introduced to reduce the gap between the simulated environment and the actual environment, and improve the robustness of the environment. Finally, combined with deep reinforcement learning, an optimal control strategy for the central air conditioning system is proposed. Aiming at the simulation environment of the central air conditioning system, a new model-free algorithm is proposed, called the dominant function upper confidence bound deep Q-network (AFUCB-DQN). The algorithm combines the advantages of an advantage function and an upper confidence bound algorithm to balance the relationship between exploration and exploitation, so as to achieve a better control strategy search. Compared with the traditional deep Q-network (DQN) algorithm, double deep Q-network (DDQN) algorithm, and the distributed double deep Q-network (D3QN) algorithm, the AFUCB-DQN algorithm has more stable convergence, faster convergence speed, and higher reward. In this study, significant energy savings of 21.5%, 21.4%, and 22.3% were obtained by conducting experiments at indoor thermal comfort levels of 24 °C, 25 °C, and 26 °C in the summer.

Predictive Control for Thermal Comfort and Energy Efficiency in a Direct Expansion Air Conditioning System

A Multiple Model Approach for Predictive Control of Indoor Thermal Environment with High Resolution

Model predictive control of indoor thermal environment conditioned by a direct expansion air conditioning system

A Control-Oriented Semi-Physical Model for A Direct Expansion Air Conditioning System

Steady-State Performance Prediction for a Variable Speed Direct Expansion Air Conditioning System Using a White-Box Based Modeling Approach

Feedforward decoupling control of indoor temperature and humidity using a single direct expansion air conditioning unit

Multi-Zone Building Temperature Control and Energy Efficiency Using Autonomous Hierarchical Control Strategy

Event‐triggered distributed model predictive control scheme for temperature regulation in multi‐zone air conditioning systems with improved indoor thermal preference indicator

An adaptive controller based dynamic simulation of household air-conditioner with indirect evaporative cooler as dedicated outdoor air system

Model predictive control for thermal comfort and energy optimization of an air handling unit system in airport terminals using occupant feedback

Heating Control Strategy Based on Dynamic Programming for Building Energy Saving and Emission Reduction

A novel hybrid steady-state model based controller for simultaneous indoor air temperature and humidity control

Performance optimization of HVAC systems with computational intelligence algorithms

Explicit model predictive control of split-type air conditioning system

Detection of persistent polioviruses in patients with the post- polio syndrome

Model predictive control with adaptive machine-learning-based model for building energy efficiency and comfort optimization

Optimal Control Strategy for Building HVAC Systems: Satisfying Flexible Demand Response with Different Value-Based Selection

Energy-efficient control of thermal comfort in multi-zone residential HVAC via reinforcement learning

Zoned HVAC Control via PDE-Constrained Optimization

Optimization Control Strategy for a Central Air Conditioning System Based on AFUCB-DQN

Application of energy combined thermal comfort in intelligent building management in complex environments