Nonintrusive Load Monitoring (NILM) Using a Deep Learning Model with a Transformer-Based Attention Mechanism and Temporal Pooling

Mohammad Irani Azad,Roozbeh Rajabi,Abouzar Estebsari
DOI: https://doi.org/10.3390/electronics13020407
IF: 2.9
2024-01-19
Electronics
Abstract:Nonintrusive load monitoring (NILM) is an important technique for energy management and conservation. In this paper, a deep learning model based on an attention mechanism, temporal pooling, residual connections, and transformers is proposed. This article presents a novel approach for NILM to accurately discern energy consumption patterns of individual household appliances. The proposed method entails a sequence of layers, including encoders, transformers, attention, temporal pooling, and residual connections, offering a comprehensive solution for NILM while effectively capturing appliance-specific energy usage in a household. The proposed model was evaluated using UK-DALE, REDD, and REFIT datasets in both seen and unseen cases. It shows that the proposed model in this paper performs better than other methods stated in other papers in terms of F1-score and total error of the results (in terms of SAE). This model achieved an F1-score equal to 92.96 as well as a total SAE equal to −0.036, which shows its effectiveness in accurately diagnosing and estimating the energy consumption of individual home appliances. The findings of this research show that the proposed model can be a tool for energy management in residential and commercial buildings.
engineering, electrical & electronic,computer science, information systems,physics, applied
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the accurate identification and estimation of household electrical appliance energy consumption in non - invasive load monitoring (NILM). Specifically, the author proposes a deep - learning - based method, which combines the attention mechanism, time pooling, residual connection and Transformer architecture, aiming to more accurately identify and estimate the energy consumption patterns of individual household electrical appliances. This method can effectively capture the specific energy consumption situation of each household appliance at home, thus providing strong support for energy management and energy conservation. The paper mentions that traditional NILM methods usually rely on manual feature extraction and rule - based algorithms to separate energy consumption data, while neural - network - based methods can automatically extract features and better learn the subtle patterns in the data. In particular, the model proposed in this paper can perform better when dealing with complex and diverse energy consumption scenarios by using advanced deep - learning techniques such as the attention mechanism and Transformer, and shows stronger robustness especially in the face of noisy or unstructured data. Experimental results show that this model is superior to other existing methods in terms of F1 score and total error (measured by SAE), proving its effectiveness in accurately diagnosing and estimating the energy consumption of individual household electrical appliances.