Abstract:An effective and accurate building energy consumption prediction model is an important means to effectively use building management systems and improve energy efficiency. To cope with the development and changes in digital data, data-driven models, especially deep learning models, have been applied for the prediction of energy consumption and have achieved good accuracy. However, as a deep learning model that can process high-dimensional data, the model often lacks interpretability, which limits the further application and promotion of the model. This paper proposes three interpretable encoder and decoder models based on long short-term memory (LSTM) and self-attention. Attention based on hidden layer states and feature-based attention improves the interpretability of the deep learning models. A case study of one office building is discussed to demonstrate the proposed method and models. Firstly, the addition in future real weather information yields only a 0.54% improvement in the MAPE. The visualization of the model attention weights improves the interpretability of the model at the hidden state level and feature level. For the hidden state of different time steps, the LSTM network will focus on the hidden state of the last time step because it contains more information. The Transformer model gives almost equal attention weight to each day in the coding sequence. For the interpretable results at the feature level, daily max temperature, mean temperature, min temperature, and dew point temperature are the four most important features. The four characteristics of pressure, wind speed-related features, and holidays have the lowest average weights.

Interpretable LSTM Based on Mixture Attention Mechanism for Multi-Step Residential Load Forecasting

A Novel Sequence-to-Sequence-Based Deep Learning Model for Multistep Load Forecasting.

Interpretable Memristive LSTM Network Design for Probabilistic Residential Load Forecasting

Residential Load Forecasting Based on LSTM Fusing Self-Attention Mechanism with Pooling

A Novel Model for the Prediction of Long-Term Building Energy Demand: LSTM with Attention Layer

A Method of Load Forecasting Based on Temporal Convolutional Network

A Hybrid Residential Short-Term Load Forecasting Method Using Attention Mechanism and Deep Learning

Temporal Pattern Attention-Based Sequence to Sequence Model for Multistep Individual Load Forecasting.

Short-term Load Forecasting Method Based on LSTM-Attention Mechanism

Short-Term Load Forecasting Based on Deep Learning Bidirectional LSTM Neural Network

Interpretable Short-Term Load Forecasting via Multi-Scale Temporal Decomposition

Short-term load forecasting based on LSTM networks considering attention mechanism

Short-Term Household Load Forecasting Based on Attention Mechanism and CNN-ICPSO-LSTM

Multi-objective LSTM ensemble model for household short-term load forecasting

Load Forecasting Method for Building Energy Systems Based on Modified Two-Layer LSTM

Interpretable deep learning model for building energy consumption prediction based on attention mechanism

Short-Term Load Forecasting and Associated Weather Variables Prediction Using ResNet-LSTM Based Deep Learning

Ultra short term power load forecasting based on the fusion of Seq2Seq BiLSTM and multi head attention mechanism

A Short-Term Residential Load Forecasting Model Based on LSTM Recurrent Neural Network Considering Weather Features

Multi-Convolution Feature Extraction and Recurrent Neural Network Dependent Model for Short-Term Load Forecasting

Short-term load prediction with LSTM and FCNN models Based on attention mechanisms