Transfer Learning in Transformer-Based Demand Forecasting For Home Energy Management System

Gargya Gokhale,Jonas Van Gompel,Bert Claessens,Chris Develder
DOI: https://doi.org/10.1145/3600100.3626635
2023-10-30
Abstract:Increasingly, homeowners opt for photovoltaic (PV) systems and/or battery storage to minimize their energy bills and maximize renewable energy usage. This has spurred the development of advanced control algorithms that maximally achieve those goals. However, a common challenge faced while developing such controllers is the unavailability of accurate forecasts of household power consumption, especially for shorter time resolutions (15 minutes) and in a data-efficient manner. In this paper, we analyze how transfer learning can help by exploiting data from multiple households to improve a single house's load forecasting. Specifically, we train an advanced forecasting model (a temporal fusion transformer) using data from multiple different households, and then finetune this global model on a new household with limited data (i.e. only a few days). The obtained models are used for forecasting power consumption of the household for the next 24 hours~(day-ahead) at a time resolution of 15 minutes, with the intention of using these forecasts in advanced controllers such as Model Predictive Control. We show the benefit of this transfer learning setup versus solely using the individual new household's data, both in terms of (i) forecasting accuracy ($\sim$15\% MAE reduction) and (ii) control performance ($\sim$2\% energy cost reduction), using real-world household data.
Machine Learning,Systems and Control
What problem does this paper attempt to address?
The paper aims to address the issue of short-term power consumption forecasting in Home Energy Management Systems (HEMS). Specifically, the researchers focus on how to use transfer learning methods to extract useful information from data across multiple households to improve the accuracy of load forecasting for individual households. The main objectives include: 1. **Data Efficiency**: By utilizing data from multiple households to train a global model and fine-tuning it on new households, the need for large amounts of data is reduced. 2. **Improving Forecast Accuracy**: Using the Temporal Fusion Transformer (TFT) model to achieve higher accuracy in load forecasting, especially at a 15-minute time resolution. 3. **Optimizing Control Strategies**: By improving load forecasting, optimize control strategies in home energy management systems, such as Model Predictive Control (MPC), to reduce energy costs. The research results indicate that the transfer learning method improved forecasting accuracy by approximately 15% and achieved around a 2% reduction in energy costs in terms of control performance. These improvements help households better manage energy consumption and participate in future energy markets.