A reinforcement learning approach for control of window behavior to reduce indoor PM2.5 concentrations in naturally ventilated buildings

Yuting An,Tongling Xia,Ruoyu You,Dayi Lai,Junjie Liu,Chun Chen
DOI: https://doi.org/10.1016/j.buildenv.2021.107978
IF: 7.093
2021-08-01
Building and Environment
Abstract:<p>Smart control of window behavior is a means of effectively reducing concentrations of indoor PM<sub>2.5</sub> (particulate matter with aerodynamic diameter less than 2.5 μm) in naturally ventilated residential buildings without indoor air cleaning devices. This study aimed to develop a reinforcement learning approach to automatically control window behavior in real time for mitigation of indoor PM<sub>2.5</sub> pollution. The proposed method trains the window controller with the use of a deep Q-network (DQN) in a specific naturally ventilated apartment in the course of a month. The trained controller can then be employed to control window behavior in order to reduce the indoor PM<sub>2.5</sub> concentrations in that apartment. The required input data for the controller are the real-time indoor and outdoor PM<sub>2.5</sub> concentrations with a 1-min resolution, which can easily be obtained with low-cost sensors available on the market. A series of simulations were conducted in a virtual typical apartment in Beijing and a real apartment in Tianjin. The results show that, compared with the baseline I/O ratio algorithm, the proposed reinforcement learning window-control algorithm reduced the average indoor PM<sub>2.5</sub> concentration by 12.80% in a one-year period. Furthermore, the proposed algorithm reduced the indoor PM<sub>2.5</sub> concentrations in the real apartment by 9.11% when compared with the I/O ratio algorithm and by 7.40% when compared with real window behavior.</p>
engineering, environmental,construction & building technology, civil
What problem does this paper attempt to address?