Data quality assessment for on-line monitoring and measuring system of power quality based on big data and data provenance theory

Wang Honggang,Cai Yaqi,Shi Mingtai,Tian Hongxun,Z. Kun,Li Hao-song,Xu Zhong-ping,Kang Taifeng,Li Jin
DOI: https://doi.org/10.1109/ICCCBDA.2018.8386521
2018-04-01
Abstract:Currently, on-line monitoring and measuring system of power quality has accumulated a huge amount of data. In the age of big data, those data integrated from various systems will face big data application problems. This paper proposes a data quality assessment system method for on-line monitoring and measuring system of power quality based on big data and data provenance to assess integrity, redundancy, accuracy, timeliness, intelligence and consistency of data set and single data. Specific assessment rule which conforms to the situation of on-line monitoring and measuring system of power quality will be devised to found data quality problems. Thus it will provide strong data support for big data application of power quality.
Environmental Science,Engineering,Computer Science
What problem does this paper attempt to address?