Abstract:Heat loss quantification (HLQ) is an essential step in improving a building's thermal performance and optimizing its energy usage. While this problem is well-studied in the literature, most of the existing studies are either qualitative or minimally driven quantitative studies that rely on localized building envelope points and are, thus, not suitable for automated solutions in energy audit applications. This research work is an attempt to fill this gap of knowledge by utilizing intensive thermal data (on the order of 100,000 plus images) and constitutes a relatively new area of analysis in energy audit applications. Specifically, we demonstrate a novel process using deep-learning methods to segment more than 100,000 thermal images collected from an unmanned aerial system (UAS). To quantify the heat loss for a building envelope, multiple stages of computations need to be performed: object detection (using Mask-RCNN/Faster R-CNN), estimating the surface temperature (using two clustering methods), and finally calculating the overall heat transfer coefficient (e.g., the U-value). The proposed model was applied to eleven academic campuses across the state of North Dakota. The preliminary findings indicate that Mask R-CNN outperformed other instance segmentation models with an mIOU of 73% for facades, 55% for windows, 67% for roofs, 24% for doors, and 11% for HVACs. Two clustering methods, namely K-means and threshold-based clustering (TBC), were deployed to estimate surface temperatures with TBC providing consistent estimates across all times of the day over K-means. Our analysis demonstrated that thermal efficiency not only depended on the accurate acquisition of thermal images but also relied on other factors, such as the building geometry and seasonal weather parameters, such as the outside/inside building temperatures, wind, time of day, and indoor heating/cooling conditions. Finally, the resultant U-values of various building envelopes were compared with recommendations from the American Society of Heating, Refrigerating, and Air-conditioning Engineers (ASHRAE) building standards.

A U-net convolutional neural network deep learning model application for identification of energy loss in infrared thermographic images

A residual convolutional neural network with multi-block for appliance recognition in non-intrusive load identification

Two-stream Convolutional Neural Network for Non-Destructive Subsurface Defect Detection Via Similarity Comparison of Lock-in Thermography Signals

Two-stage Convolutional Neural Network for Joint Removal of Sensor Noise and Background Interference in Lock-in Thermography

Spatio-Temporal 3-D Residual Networks for Simultaneous Detection and Depth Estimation of CFRP Subsurface Defects in Lock-In Thermography

Automated detection and classification of concealed objects using infrared thermography and convolutional neural networks

Deep Learning-based Method for PV Panels Segmentation and Defects Detection with Infrared Images

Segmentation Framework for Heat Loss Identification in Thermal Images: Empowering Scottish Retrofitting and Thermographic Survey Companies

Infrared UAV Target Detection Based on Continuous-Coupled Neural Network

Research on Fault Detection Method of Infrared Thermal Imaging for Power Equipment based on Deep Learning

Infrared Image Segmentation for Photovoltaic Panels Based on Res-UNet

Semantic segmentation of thermal defects in belt conveyor idlers using thermal image augmentation and U-Net-based convolutional neural networks

An Improved U-Net Infrared Small Target Detection Algorithm Based on Multi-Scale Feature Decomposition and Fusion and Attention Mechanism

RCAU-Net: convolutional networks with residual channel attention for non-uniformity correction

Dense Nested Attention Network for Infrared Small Target Detection

Electrical equipment identification in infrared images based on ROI-selected CNN method

Spatiotemporal crowds features extraction of infrared images using neural network

SCINet: Spatial and Contrast Interactive Super-Resolution Assisted Infrared UAV Target Detection

An Instance Segmentation and Clustering Model for Energy Audit Assessments in Built Environments: A Multi-Stage Approach

Implementation of deep neural networks learning on unmanned aerial vehicle based remote-sensing

Automatic Identification of Strong Energy Noise in Seismic Data Based on U-Net