Federated Learning for Short-term Residential Load Forecasting

Christopher Briggs,Zhong Fan,Peter Andras
DOI: https://doi.org/10.48550/arXiv.2105.13325
2022-09-08
Abstract:Load forecasting is an essential task performed within the energy industry to help balance supply with demand and maintain a stable load on the electricity grid. As supply transitions towards less reliable renewable energy generation, smart meters will prove a vital component to facilitate these forecasting tasks. However, smart meter adoption is low among privacy-conscious consumers that fear intrusion upon their fine-grained consumption data. In this work we propose and explore a federated learning (FL) based approach for training forecasting models in a distributed, collaborative manner whilst retaining the privacy of the underlying data. We compare two approaches: FL, and a clustered variant, FL+HC against a non-private, centralised learning approach and a fully private, localised learning approach. Within these approaches, we measure model performance using RMSE and computational efficiency. In addition, we suggest the FL strategies are followed by a personalisation step and show that model performance can be improved by doing so. We show that FL+HC followed by personalisation can achieve a $\sim$5\% improvement in model performance with a $\sim$10x reduction in computation compared to localised learning. Finally we provide advice on private aggregation of predictions for building a private end-to-end load forecasting application.
Machine Learning,Computers and Society
What problem does this paper attempt to address?
The main problem that this paper attempts to solve is **how to use Federated Learning (FL) technology for short - term residential load forecasting under the premise of protecting user privacy**. Specifically, the paper focuses on the following aspects: 1. **Privacy Protection and Data Distribution Problems**: - With the increase in renewable energy, the volatility of electricity demand has increased, and smart meters have become important tools for balancing supply and demand and maintaining grid stability. - However, due to privacy issues, many consumers are reluctant to install smart meters, resulting in difficulties in data acquisition. Traditional centralized learning methods require all data to be concentrated in a central location for training, which may violate users' privacy. - For this reason, the paper proposes to use Federated Learning (FL), enabling the model to be trained in a distributed and collaborative manner while preserving the privacy of the underlying data. 2. **Model Performance and Computational Efficiency**: - The paper compares two Federated Learning methods: standard Federated Learning (FL) and Federated Learning based on hierarchical clustering (FL + HC), and compares them with non - private centralized learning and fully private localized learning. - Among these methods, the paper measures model performance through Root Mean Square Error (RMSE) and computational efficiency. 3. **The Influence of the Personalization Step**: - The paper also explores the possibility of introducing a personalization step after Federated Learning and shows that in this way, the model performance can be further improved. - The experimental results show that FL + HC combined with the personalization step can improve the model performance by about 5% and reduce the amount of computation by about 10 times. 4. **Handling of Non - IID (Non - Independent and Identically Distributed) Data**: - Since the electricity consumption patterns of different households vary greatly, the data exhibits the characteristics of non - independent and identically distributed, which poses a challenge to the effectiveness of Federated Learning. - The paper introduces Hierarchical Clustering (HC) to address this problem, improving the generalization ability of the model by grouping similar data. In summary, this paper aims to improve the accuracy and computational efficiency of short - term residential load forecasting while protecting user privacy through Federated Learning technology.