Infrared-Fused Vision-Based Thermoregulation Performance Estimation for Personal Thermal Comfort-Driven HVAC System Controls

Ali Ghahramani,Qian Xu,Syung Min,Andy Wang,Hui Zhang,Yingdong He,Alexander Merritt,Ronnen Levinson
DOI: https://doi.org/10.3390/buildings12081241
IF: 3.324
2022-08-16
Buildings
Abstract:Thermal comfort is one of the primary factors influencing occupant health, well-being, and productivity in buildings. Existing thermal comfort systems require occupants to frequently communicate their comfort vote via a survey which is impractical as a long-term solution. Here, we present a novel thermal infrared-fused computer vision sensing method to capture thermoregulation performance in a non-intrusive and non-invasive manner. In this method, we align thermal and visible images, detect facial segments (i.e., nose, eyes, face boundary), and accordingly read the temperatures from the appropriate coordinates in the thermal image. We focus on the human face since it is often clearly visible to cameras and is not merged into a hot background (unlike hands). We use a regularized Gaussian Mixture model to track the thermoregulation changes over time and apply a heuristic algorithm to extract hot and cold indices. We present a personalized and a generalized comfort modeling method, selected based on the availability of the occupant historical indices measurements in a neutral environment, and use the time-series of the hot and cold indices to define corrections to HVAC system operations in the form of setpoint constraints. To evaluate the efficacy of our proposed approach in responding to thermal stimuli, we designed a series of controlled experiments to simulate exposure to cold and hot environments. While applying personalized modeling showed an acceptable average accuracy of 91.3%, the generalized model's average accuracy was only 65.2%. This shows the importance of having access to physiological records in modeling and assessing comfort. We also found that individual differences should be considered in selecting the cooling and heating rates when some knowledge of the occupant's overall thermal preference is available.
construction & building technology,engineering, civil
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the deficiencies of existing heating, ventilation, and air - conditioning (HVAC) systems in providing individual thermal comfort. Specifically: 1. **Limitations of Existing Systems**: - Existing thermal comfort systems rely on users frequently providing feedback on their comfort through surveys, which is impractical in long - term implementation. - Traditional HVAC systems usually operate based on fixed set values and will only adjust these set values when users complain. - Due to individual differences (such as body mass index, gender, etc.) and physiological and psychological changes, users' thermal comfort will change over time and among individuals, resulting in low comfort scores and energy waste. 2. **Research Objectives**: - Develop a non - invasive, non - contact infrared - fused computer vision sensing method to monitor individuals' thermoregulatory performance and thermal comfort. - Eliminate the need for frequent user feedback and assess thermal comfort by automatically monitoring facial temperature. - Provide personalized thermal comfort models and generalized thermal comfort models to adapt to different application scenarios. - Use time - series data to define modifications to HVAC system operations to optimize the indoor thermal environment. 3. **Specific Problems**: - How can individual thermal comfort be monitored and evaluated in real - time without requiring frequent user feedback? - How can infrared imaging and computer vision techniques be used to accurately capture facial temperature changes? - How can the set values of HVAC systems be adjusted according to individual differences and short - term and long - term physiological changes? By solving these problems, this research aims to improve the thermal comfort of users in buildings, while reducing energy waste and improving overall energy efficiency. ### Formula Representation Some key formulas involved in the paper are as follows: - **Hot Index (HI) and Cold Index (CI)**: \[ HI_t=\text{median}(\text{top 10 hottest points on the face}) \] \[ CI_t = \text{median}(\text{bottom 5 coldest points on the face}) \] - **Conditions for Judging Thermal Comfort States**: \[ \text{If }(HI_t - CI_t)>(HI_N - CI_N), \text{ then the subject is too cool} \] \[ \text{If }HI_t>HI_N \text{ or if }HI_t<HI_N \text{ but }(HI_t - CI_t)\approx(HI_N - CI_N), \text{ then the subject is too warm} \] - **Algorithm for Adjusting Setpoint (SP)**: \[ \text{If }(HI_t - CI_t)>(HI_N - CI_N): \] \[ SP_t = SP_0+\alpha(HI_t - CI_t - HI_N + CI_N) \] \[ \text{Else if }HI_t>HI_N: \] \[ SP_t = SP_0-\beta(HI_t - HI_N) \] \[ \text{Else if }HI_t<HI_N: \] \[ SP_t = SP_0-\gamma(HI_N - HI_t) \] \[ \text{Else:} \] \[ SP_t = SP_0 \] where \(HI_N\) and \(CI_N\) are the measured values under neutral conditions, and \(\alpha\), \(\beta\) and \(\gamma\) are weights.