Abstract:To conserve building energy, optimal operation of a building’s energy systems, especially heating, ventilation and air-conditioning (HVAC) systems, is important. This study focuses on the optimization of the central chiller plant, which accounts for a large portion of the HVAC system’s energy consumption. Classic optimal control methods for central chiller plants are mostly based on system performance models which takes much effort and cost to establish. In addition, inevitable model error could cause control risk to the applied system. To mitigate the model dependency of HVAC optimal control, reinforcement learning (RL) algorithms have been drawing attention in the HVAC control domain due to its model-free feature. Currently, the RL-based optimization of central chiller plants faces several challenges: (1) existing model-free control methods based on RL typically adopt single-agent scheme, which brings high training cost and long training period when optimizing multiple controllable variables for large-scaled systems; (2) multi-agent scheme could overcome the former problem, but it also requires a proper coordination mechanism to harmonize the potential conflicts among all involved RL agents; (3) previous agent coordination frameworks (identified by distributed control or decentralized control) are mainly designed for model-based control methods instead of model-free controllers. To tackle the problems above, this article proposes a multi-agent, model-free optimal control approach for central chiller plants. This approach utilizes game theory and the RL algorithm SARSA for agent coordination and learning, respectively. A data-driven system model is set up using measured field data of a real HVAC system for simulation. The simulation case study results suggest that the energy saving performance (both short- and long-term) of the proposed approach (over 10% in a cooling season compared to the rule-based baseline controller) is close to the classic multi-agent reinforcement learning (MARL) algorithm WoLF-PHC; moreover, the proposed approach’s nature of few pending parameters makes it more feasible and robust for engineering practices than the WoLF-PHC algorithm.

A Non-Cooperative Game-Based Distributed Optimization Method for Chiller Plant Control

A Game-Theoretic Approach to Decentralized Control of Heterogeneous Load Population

Distributed Real-Time Multi-Objective Control of a Virtual Power Plant in DC Distribution Systems

Multi-objective Optimization of a Novel Combined Cooling, Dehumidification and Power System Using Improved M-PSO Algorithm

Optimal Control of Chiller Plant based on Models Identificated with Field Data

Optimization Control of Ice Storage Air-Conditioning System

A Decentralized Algorithm for Optimal Distribution in HVAC Systems

A Collaborative Neurodynamic Optimization Approach to Distributed Chiller Loading

Distributed Optimization of Multi-Building Energy Systems with Spatially and Temporally Coupled Constraints

Multi-Agent Optimal Control for Central Chiller Plants Using Reinforcement Learning and Game Theory

A general multi agent-based distributed framework for optimal control of building HVAC systems

Distributed real-time optimal control of central air-conditioning systems

A Data-Driven Method for the Optimal Control of Centralized Cooling Station in an Office Park

Cooperative Optimization of a Refrigeration System with a Water-Cooled Chiller and Air-Cooled Heat Pump by Coupling BPNN and PSO

Optimal real-time dispatching of chillers and thermal storage tank in a university campus central plant

Optimizing multi-chiller dispatch in HVAC system using equilibrium optimization algorithm

Optimal Chiller Loading Based on Collaborative Neurodynamic Optimization

Design and Operation Optimization of Multi-Chiller Plants Based on Energy Performance Simulation

Efficient management of HVAC systems through coordinated operation of parallel chiller units: An economic predictive control approach

Research on Systematic Analysis and Optimization Method for Chillers Based on Model Predictive Control: A Case Study

Optimal chiller loading in HVAC System Using a Novel Algorithm Based on the distributed framework