The Energy Prediction Smart-Meter Dataset: Analysis of Previous Competitions and Beyond

Direnc Pekaslan,Jose Maria Alonso-Moral,Kasun Bandara,Christoph Bergmeir,Juan Bernabe-Moreno,Robert Eigenmann,Nils Einecke,Selvi Ergen,Rakshitha Godahewa,Hansika Hewamalage,Jesus Lago,Steffen Limmer,Sven Rebhan,Boris Rabinovich,Dilini Rajapasksha,Heda Song,Christian Wagner,Wenlong Wu,Luis Magdalena,Isaac Triguero

2023-11-07

Abstract:This paper presents the real-world smart-meter dataset and offers an analysis of solutions derived from the Energy Prediction Technical Challenges, focusing primarily on two key competitions: the IEEE Computational Intelligence Society (IEEE-CIS) Technical Challenge on Energy Prediction from Smart Meter data in 2020 (named EP) and its follow-up challenge at the IEEE International Conference on Fuzzy Systems (FUZZ-IEEE) in 2021 (named as XEP). These competitions focus on accurate energy consumption forecasting and the importance of interpretability in understanding the underlying factors. The challenge aims to predict monthly and yearly estimated consumption for households, addressing the accurate billing problem with limited historical smart meter data. The dataset comprises 3,248 smart meters, with varying data availability ranging from a minimum of one month to a year. This paper delves into the challenges, solutions and analysing issues related to the provided real-world smart meter data, developing accurate predictions at the household level, and introducing evaluation criteria for assessing interpretability. Additionally, this paper discusses aspects beyond the competitions: opportunities for energy disaggregation and pattern detection applications at the household level, significance of communicating energy-driven factors for optimised billing, and emphasising the importance of responsible AI and data privacy considerations. These aspects provide insights into the broader implications and potential advancements in energy consumption prediction. Overall, these competitions provide a dataset for residential energy research and serve as a catalyst for exploring accurate forecasting, enhancing interpretability, and driving progress towards the discussion of various aspects such as energy disaggregation, demand response programs or behavioural interventions.

Machine Learning,Artificial Intelligence

What problem does this paper attempt to address?

The paper primarily focuses on accurately predicting household-level energy consumption using smart meter data and emphasizes the interpretability of the prediction results. Specifically, the paper explores two key competitions—the 2020 IEEE Computational Intelligence Society (IEEE-CIS) Technical Challenge (referred to as EP) and the subsequent challenge at the 2021 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE) (referred to as XEP). Both competitions aim to improve the accuracy of energy consumption predictions using real-world smart meter datasets, with the XEP competition particularly emphasizing the interpretability of the prediction models.

The main issues addressed in the paper include:
1. **Accurately predicting household-level energy consumption**: Using limited historical data to predict the estimated monthly and yearly energy consumption of households to address accurate billing issues.
2. **Enhancing the interpretability of prediction models**: In the XEP competition, in addition to improving prediction accuracy, participants were also required to develop models that are easy to understand so that customers can clearly understand the logic behind the prediction process.

The paper uses a real-world dataset containing 3,248 smart meters, with data availability ranging from a minimum of one month to a maximum of one year. Additionally, the paper discusses challenges related to real-world smart meter data, such as data quality, seasonal patterns, and missing values, and proposes methods for evaluating prediction accuracy and interpretability.

Overall, the goal of this paper is to improve household-level energy consumption predictions using smart meter data and to enhance customer experience by improving the interpretability of prediction models. These two competitions not only provide benchmark problems and datasets for researchers but also open new directions for future research, such as energy disaggregation, demand response programs, and behavioral interventions.