Evaluation of big data frameworks for analysis of smart grids

Mohammad Hasan Ansari,Vahid Tabatab Vakili,Behnam Bahrak
DOI: https://doi.org/10.1186/s40537-019-0270-8
2019-12-01
Journal Of Big Data
Abstract:Abstract With the rapid development of smart grids and increasing data collected in these networks, analyzing this massive data for applications such as marketing, cyber-security, and performance analysis, has gained popularity. This paper focuses on analysis and performance evaluation of big data frameworks that are proposed for handling smart grid data. Since obtaining large amounts of smart grid data is difficult due to privacy concerns, we propose and implement a large scale smart grid data generator to produce massive data under conditions similar to those in real smart grids. We use four open source big data frameworks namely Hadoop-Hbase, Cassandra, Elasticsearch, and MongoDB, in our implementation. Finally, we evaluate the performance of different frameworks on smart grid big data and present a performance benchmark that includes common data analysis techniques on smart grid data.
What problem does this paper attempt to address?