Abstract:Despite the large share of energy consumption, current HVAC systems in buildings fail to meet their primary purpose of maintaining comfortable indoor conditions. Current "one size fits all" approach to control the thermal conditions in an environment lead to a high degree of occupant dissatisfaction. Advancements in Internet of Things and Machine Learning have opened the possibility of deploying different sensors at a wide scale to monitor environmental and physiological information and using collected sensor data to model individual comfort requirements. Thermal imaging has recently gained interest as one of the possible ways to monitor physiological information (skin temperature) for thermal comfort assessment. Previous studies have shown that skin temperatures from different regions of the face, such as forehead, nose, cheeks and ears can provide useful information for predicting thermal sensation at an individual level. However, existing approaches to process thermal images either rely on manual temperature extraction or use methods that are less reliable in accurately identifying different facial regions. One of the major challenges of using thermal imaging for monitoring skin temperatures in actual buildings is that occupants may move relative to the camera. It is not practical to expect building occupants to be oriented facing the cameras at all times, therefore, it is important to be able to extract as much information as possible from instances where it is feasible to extract relevant information. In this paper, we describe an approach to extract skin temperature by locating specific regions of the face in thermal images. The approach involves combining data from RGB images with thermal images and leveraging facial landmark detection in RGB images. We also evaluate our approach with existing approach of face detection used in previous studies. Our study demonstrates that facial landmark detection provides a more accurate calculation of different locations in the face compared to previous studies. We show an improvement in overall quantity and quality of temperature measurements extracted from thermal images compared to previous studies. More accurate temperature measurements from thermal images can improve the accuracy of thermal imaging for modeling and predicting thermal comfort.

AutoTherm: A Dataset and Benchmark for Thermal Comfort Estimation Indoors and in Vehicles

More intelligent and efficient thermal environment management: A hybrid model for occupant-centric thermal comfort monitoring in vehicle cabins

A novel method based on thermal image to predict the personal thermal comfort in the vehicle

Application-driven development of a thermal imaging-based cabin occupant thermal sensation assessment model and its validation

Toward Intelligent Car Comfort Sensing: New Dataset and Analysis of Annotated Physiological Metrics

Are You Comfortable Now: Deep Learning the Temporal Variation in Thermal Comfort in Winters

Deep learning and thermographic imaging method for thermal comfort prediction in different genders

Infrared-Fused Vision-Based Thermoregulation Performance Estimation for Personal Thermal Comfort-Driven HVAC System Controls

Field studies of the Artificial Intelligence model for defining indoor thermal comfort to acknowledge the adaptive aspect

Machine Learning-Based Automated Thermal Comfort Prediction: Integration of Low-Cost Thermal and Visual Cameras for Higher Accuracy

Personal comfort models based on a 6‐month experiment using environmental parameters and data from wearables

Occupant-Centric Cabin Thermal Sensation Assessment System Based on Low-Cost Thermal Imaging

Performances of machine learning algorithms for individual thermal comfort prediction based on data from professional and practical settings

Non-intrusive personal thermal comfort modeling: A machine learning approach using infrared face recognition

Reinforcement learning-based thermal comfort control for vehicle cabins

Real-time indoor thermal comfort prediction in campus buildings driven by deep learning algorithms

A Machine Learning approach for personal thermal comfort perception evaluation: experimental campaign under real and virtual scenarios

Skin Temperature Extraction Using Facial Landmark Detection and Thermal Imaging for Comfort Assessment

An Overview of Current Methods for Thermal Comfort Assessment in Vehicle Cabin

Heat Flux Sensing for Machine-Learning-Based Personal Thermal Comfort Modeling

Non-invasive measurements of thermal discomfort for thermal preference prediction based on occupants' adaptive behavior recognition