Abstract:Individual device loads and energy consumption feedback is one of the important approaches for pursuing users to save energy in residences. This can help in identifying faulty devices and wasted energy by devices when left On unused. The main challenge is to identity and estimate the energy consumption of individual devices without intrusive sensors on each device. Non-intrusive load monitoring (NILM) or energy disaggregation, is a blind source separation problem which requires a system to estimate the electricity usage of individual appliances from the aggregated household energy consumption. In this paper, we propose a novel deep neural network-based approach for performing load disaggregation on low frequency power data obtained from residential households. We combine a series of one-dimensional Convolutional Neural Networks and Long Short Term Memory (1D CNN-LSTM) to extract features that can identify active appliances and retrieve their power consumption given the aggregated household power value. We used CNNs to extract features from main readings in a given time frame and then used those features to classify if a given appliance is active at that time period or not. Following that, the extracted features are used to model a generation problem using LSTM. We train the LSTM to generate the disaggregated energy consumption of a particular appliance. Our neural network is capable of generating detailed feedback of demand-side, providing vital insights to the end-user about their electricity consumption. The algorithm was designed for low power offline devices such as ESP32. Empirical calculations show that our model outperforms the state-of-the-art on the Reference Energy Disaggregation Dataset (REDD).

Using streaming data and Apache Flink to infer energy consumption

Anomaly detection for NILM task with Apache Flink

A Survey of the Research on Non-intrusive Load Monitoring and Disaggregation

Solving the 2021 DEBS grand challenge using Apache Flink

An efficient architecture for processing real-time traffic data streams using apache flink

A Fusion Framework Using Integrated Neural Network Model for Non-Intrusive Load Monitoring

Distributed Streaming Analytics on Large-scale Oceanographic Data using Apache Spark

A Deep Learning Technique using Low Sampling rate for residential Non Intrusive Load Monitoring

A Scalable and Robust Framework for Data Stream Ingestion

Exploring Real-Time Data Processing Using Big Data Frameworks

Augmenting an Assisted Living Lab with Non-Intrusive Load Monitoring

DataEther: Data Exploration Framework for Ethereum

Benchmarking Distributed Stream Data Processing Systems

Resilient data-driven non-intrusive load monitoring for efficient energy management using machine learning techniques

Continuous Outlier Mining of Streaming Data in Flink

Low-Complexity Non-Intrusive Load Monitoring Using Unsupervised Learning and Generalized Appliance Models

Poster Abstract: Bits and Watts: Improving energy disaggregation performance using power line communication modems

A Dynamical Systems Approach to Energy Disaggregation

Detecting Anomalous Users via Streaming Data Processing in Smart Grid

Anomaly Detection over Streaming Data : Indy 500

Universal Non-Intrusive Load Monitoring (UNILM) Using Filter Pipelines, Probabilistic Knapsack, and Labelled Partition Maps