Reinforcement Learning-based District Cooling System Control for Voltage Regulation in Distribution Networks.

Peipei Yu,Hongcai Zhang,Zechun Hu,Yonghua Song
DOI: https://doi.org/10.1109/ISGTEUROPE56780.2023.10407165
2023-01-01
Abstract:High penetration of distributed renewable generation is being integrated into modern distribution networks. This will lead to reverse and intermittent power flow that may deteriorate voltage stability. A district cooling system (DCS), as a large-capacity and high-efficiency demand-side thermostatically controllable load, can be controlled in coordination with distributed renewable generation for voltage regulation. However, the unpredictable renewable generation, complex DCS thermal dynamic model, and unobserved parameters of distribution networks seriously limited the conventional physical-model-based control in practice. To fill this gap, we propose a model-free control method for DCS to support voltage regulation in distribution networks with high penetration of renewable generation. Specifically, we formulate the DCS control problem into a Markov decision process with a well-designed state space, action space, and reward function. On top of it, we propose a model-free deep reinforcement learning algorithm to effectively train the DCS controller, which requires no knowledge of the uncertainties and physical DCS system models, nor distribution network parameters. Numerical studies based on an IEEE-33 system validated the effectiveness of the proposed method.
What problem does this paper attempt to address?